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Abstract 


Environmental  impact  statements  and  environmental  assessments,  which  can  be  large,  conq)lex  docu¬ 
ments,  are  prepared  so  that  decision  makers  can  consider  the  environmental  impacts  of  a  proposed  action 
prior  to  rnmniittiTig  resources  to  that  action.  The  National  Environmental  Policy  Act  of  1970  requires  that 
these  doc^^me;ntR  be  dear,  concise,  and  to  the  point  so  dedsion  makers  and  the  1^  public  can  understand 
them.  However,  several  authors  claim  these  documents  are  not  meding  this  requirement. 

In  an  effort  to  improve  the  usability  of  environmental  documents,  an  AFTT  CEEM  student  finom  last  year, 
Jill  A.  Easterly,  investigated  visual  and  linguistic  discourse  elements  in  sample  environmental  documents 
Iqr  altering  the  consistenqr  of  these  elements.  A  pool  of  readers  answered  short  objective  questions  about 
they  had  read  from  sanq)le  environmental  impact  statements  and  Easterly  measured  how  the 
presence  or  absence  of  cohesive  discourse  elements  affected  the  sulyect’s  performance.  The  dependent 
variables  were  accuracy  (number  of  conect  responses)  and  effidency  (time  it  took  the  subject  to  answer 
the  questions).  Unfortunately,  her  results  showed  no  statistical  significance  between  or  among  the  differ¬ 
ent  treatments. 

In  addition  to  objective  data.  Easterly  coUeded  subjective  data  from  the  readers  regarding  their  impres¬ 
sions  and  perceptions  of  the  documents  they  reviewed.  The  purpose  of  this  thesis  was  to  e)q>lore  this  sub¬ 
jective  data  and  ddermine  if  there  was  a  statistically  significant  difference  in  the  readers’  perceptions  of 
the  document’s  usability.  . 

Unfortunately,  the  results  of  this  thesis  paralleled  those  found  by  Easterly:  there  was  no  statistical  signifi¬ 
cance  between  or  among  the  different  treatments.  As  in  Easterly’s  study,  these  results  could  be  attributable 
both  to  the  design  of  the  experiment  and  to  the  underlying  theoiy  of  document  usability  itself.  Valuable 
lessons  were  learned  from  this  pilot  study  and  further  investigation  in  this  area  of  document  design  may 
return  results  which  more  closely  support  the  theory  of  document  usability. 
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PERCEPTIONS  OF  COHERENCE  AND  USABILITY 
IN  ENVIRONMENTAL  IMPACT  DOCUMENTS 
AS  FUNCTIONS  OF  VISUAL  AND  LINGUISTIC  CUES 


I.  Introduction 


Research  Objective 

The  objective  of  this  research  was  to  determine  the  extent  to  which  the  presence  or  absence  of  cohesive 
discourse  elements  in  environmental  documents  affect  user’s  perceptions  of  a  document’s  usability.  The 
environmental  documents  examined  in  this  stuufy  were  portions  of  Environmental  In^tact  Statements 
(EISs);  however,  the  findings  were  intended  to  be  equally  applicable  to  other  large-scale  environmental 
documents,  such  as  Environmental  Assessments  (EAs). 

The  concept  of  document  usability  is  founded,  in  part,  on  the  linguistic  theories  of  cohesion  and  coher¬ 
ence.  In  order  to  how  the  presence  or  absence  of  cohesive  discourse  elements  affect  document 

usability,  this  study  posed  two  Iqqxitheses  relating  cohesive  discourse  elements  to  coherence  and  usabUity. 
The  first  hypothesis  investigates  the  concept  of  coherence: 

Hypotheses 

Hypothesis  #1:  Coherent  documents  are  cohesive. 

Question:  Are  coherence  measurements,  such  as  subjects’ Likert  scale  responses  to  statements  regarding 
coherence,  relation,  manner,  quality,  and  quantity,  related  to  the  presence  or  absence  of  cohesive  dis¬ 
course  elements,  such  as  typography,  white  space,  tense,  and  syntax? 

This  hypothesis  may  be  fiamed  in  terms  of  sub-questions  which  may  be  more  directly  analyzed  through 
experimental  investigation,  such  as: 

a.  Are  perceptions  of  coherence  (comprehensibility  or  readability  of  a  discourse)  related  to  the  pres¬ 
ence  or  absence  of  cohesive  discourse  elements? 

b.  Are  perceptions  of  relation  (relevance  or  relatedness  of  information)  related  to  the  presence  or  ab¬ 
sence  of  cohesive  discourse  elements? 
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c.  Are  perceptions  of  manner  (clarity  of  information)  related  to  the  presence  or  absence  of  cohesive 
discourse  elements? 

d.  Are  perceptions  of  quality  (truth  or  accuracy  of  the  information)  related  to  the  presence  or  absence 
of  cohesive  discourse  elements? 

e.  Are  perceptions  ofauantitv  (amount  of  information)  related  to  the  presence  or  absence  of  cohesive 
discourse  elements? 

f.  Are  perceptions  of  coherence  correlated  with  perceptions  of  relation,  manner,  quality,  and  quantity? 
The  second  hypothesis  investigates  the  concept  of  usability; 

Hypothesis  #2:  Usable  documents  are  cohesive. 

Question:  Are  usability  measurements,  such  as  subjects  ’  Likert  scale  responses  to  statements  regarding 
usability,  related  to  the  presence  or  absence  of  cohesive  discourse  elements,  such  as  typography,  white 
space,  tense,  and  syntax? 

Again,  this  hypothesis  can  be  ftamed  in  terms  of  several  sub-questions; 

a.  Are  perceptions  of  usability  (ease  of  comprehending  or  withdrawing  information  Jrom  the  discourse) 
related  to  the  presence  or  absence  of  cohesive  discourse  elements? 

b.  Are  perceptions  of  usability  correlated  with  perceptions  of  coherence? 

To  answer  these  sub-questions,  and  therdry  address  the  hypotheses,  an  ejqperiment  was  performed  in 
which  certain  discourse  elements  in  sample  environmental  documents  were  manipulated.  Data  was  then 
collected  on  how  readers  responded  to  subjective  statements  about  their  perceptions  of  the  document’s  us¬ 
ability.  The  following  overview  maps  out  how  this  thesis  details  these  efforts. 

Overview  of  the  Remaining  Chapters 

This  chapter.  Introduction,  establishes  the  objective  of  the  research  and  proposes  two  hypotheses  to  be  in¬ 
vestigated.  Chapter  11,  Background,  examines  the  regulatory  requirement  for  readable  environmental  im¬ 
pact  and  discusses  the  consequences  of  violating  this  directive.  Chapter  III,  Literature  Review, 

reviews  prior  research  in  the  areas  of  coherence,  cohesion,  and  document  usability  by  discussing  the  Ge¬ 
stalt  concept  of  continuity  and  Grice’s  Maxims  for  effective  communication.  Also,  this  chapter  introduces 
the  reader  to  the  cohesive  discourse  elements  which  were  altered  in  the  experimental  test  instrument  and 
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HrfjnfiR  their  rnfaning  Chapter  IV,  Methodology,  describes  the  subjects  of  the  experiment,  explains  how 
the  experiment  was  designed,  details  the  structure  of  the  test  instrument  itself  and  outlines  the  approach 
taken  to  analyze  the  data.  Chapter  V,  Results  and  Discussion,  reports  the  results  of  data  analysis  and  dis¬ 
cusses  their  ^)parent  meaning.  The  final  chapter,  Ch^ter  VI,  Conclusions  and  Recommendations,  inter¬ 
prets  the  results  within  the  context  of  the  Iqrpotheses  and  makes  recommendations  for  further  studies. 
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II.  Background 


Legislation  and  Regulation 

In  an  effort  to  depart  from  the  “build  it  now  and  worry  about  [the  enviromnental  consequences]  later” 
mentality,  the  U.S.  Congress  enacted  ibe  National  Environmental  Policy  Act  (NEPA)  of 1969  (Bregman 
and  Mackenlhun,  1992: 1).  Subsequently,  President  Nixon  signed  NEPA  into  law  on  1  January  1970,  ush¬ 
ering  in  a  new  ‘environmental  decade.’  The  federal  mindset  is  captured  in  Title  I  of  NEPA,  Declaration 
of  National  Environmental  Policy,  which  is  a  broad-based  description  of  the  government’s  ^roach  to 
environmental  responsibility.  Title  n  of  NEPA,  Council  on  Environmental  Quality  (CEQ),  created  a 
three-member  advisory  board  in  the  Executive  Office  of  the  President  and  assigned  the  CEQ  responsibility 
for  implfimftnting  NEPA.  Executive  Orders  (EOs)  1 15 14  and  1 1991  qwcifically  directed  the  CEQ  to  draft 
the  regulation  accomplishing  this  objective.  Accordingly,  they  created  CEQ  Regulations  for  Implementing 
the  Procedural  Provisions  of  the  NEPA,  hereafter  referred  to  as  the  ‘CEQ  Regulations.’ 

As  written,  NEPA  and  the  CEQ  Regulations  apply  to  all  federal  agencies,  including  the  Department  of 
Defense  (DoD)  (40  CFR  §1500.1).  In  support  of  this  legislation,  the  DoD  followed  suit  by  issuing  DoD 
Directive  (DoDD)  6050. 1,  Environmental  Effects  in  the  United  States  of  DoD  Actions,  and  DoDD  6050.7, 
Environmental  Effects  Abroad  of  Major  DoD  Actions.  Shortly  thereafter,  the  USAF  published  APR  19-2, 
Environmental  Impact  Analysis  Process  (EIAP),  which  was  recently  superseded  by  API  32-7061,  The  En¬ 
vironmental  Impact  Analysis  Process.  The  DoD  and  USAF  directives  implemented  all  pertinent  federal 
environmental  laws,  executive  orders,  and  regulations.  The  environmental  legislation  is  summarized  in 
Table  1  on  page  5. 

With  respect  to  proposed  projects,  the  primary  question  posed  by  NEPA  and  supplementary  legislation 
was,  “What  is  the  impact  on  the  enviromnent  of  the  planned  action  and  how  can  it  be  minimized?” 
(Bregman  and  Mackenthun,  1992:2).  Attempts  to  answer  this  question  are  embodied  in  the  environmental 
documents  described  in  the  following  section. 
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Table  1 


Chronology  of  Pertinent  Environmental  Impact  Legislation  (AFI 32-7061, 1995) 


Date 

Codification 

Title 

1  Jan  70 

PL  91-190 

42  use  §§4321- 
4347 

National  Environmental  Policy  Act 
(Amended  3  Jul  75  —  PL  94-52) 

(Amended  9  Aug  75  —  PL  94-83) 

5  Mar  70 

EO  11514 

Protection  and  Enhancement  of  Environmental  Quality  that  Re¬ 
quires  Federal  Agencies  to  Implement  NEPA 
(Amended  24  May  77  ~  EO  1 1991) 

24  May  73 

DoDD  5100.50 

Protection  and  Enhancement  of  Environmental  Quality 

29  Nov  78 

40  CFR  §§1500- 
1508 

CEQ  Regulations  For  Implementing  The  Procedural  Provisions  Of 

The  National  Environmental  Policy  Act 
(Amended  1  Jul  86) 

31  Mar  79 

EO  12114 

DoDD  6050.7 

Environmental  Effects  Abroad  of  Major  DoD  Actions 

30Jul79 

DoDD  6050.1 

32  CFR  §188 

Environmental  Effects  in  the  United  States  of  DoD  Actions 

10  Aug  82 

AFR19-2 

Environmental  Impact  Analysis  Process  (EIAP) 

23  Feb  91 

DoDI  5000.2 

Defense  Acquisition  Management  Policies  and  Procedures 
(Change  1  andUSAF  Supplement  1, 31  Aug  1993) 

20  Jul  94 

AFPD  32-70 

Environmental  Quality 

24  Jan  95 

AFI  32-7061 

The  Environmental  Impact  Analysis  Process 
(Supersedes  AFR 19-2) 

Environmental  Documents 

Environmental  documents  include  Notices  of  Intent  (NOI),  Environmental  Impact  Statements  (EISs), 
Environmental  Assessments  (EAs),  and  Findings  Of  No  Significant  Impact  (FONSIs)  (40  CFR  §1508.10). 
The  purpose  of  an  environmental  document  is  to  examine  the  possible  consequences  of  a  planned  action, 
such  as  a  construction  project  (Bregman  and  Mackenthun,  1992). 

The  NOI  is  simply  a  document  describing  an  agency’s  intent  to  prepare  and  consider  an  EIS.  It  describes 
the  proposed  action,  addresses  scoping,  and  designates  a  point  of  contact  fijr  information  regarding  the 
proposed  action  and  EIS  (40  CFR  §1508.22). 

The  most  comprehensive  of  the  environmental  documents  is  the  EIS.  As  stated  in  40  CFR  §1502.1: 
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The  primary  purpose  of  an  environmental  impact  statement  is  to  serve  as  an  action-forcing  device 
to  insure  that  the  policies  and  goals  defined  in  [NEPA]  are  infused  into  the  ongoing  programs 
and  actions  of  the  Federal  Government  It  shall  provide  full  and  fiiir  discussion  of  significant  en¬ 
vironmental  impacts  and  shall  inform  decisionmakers  and  the  public  of  the  reasonable  alterna¬ 
tives  which  would  avoid  or  minimize  adverse  impacts  or  enhance  the  quality  of  the  human  envi¬ 
ronment.  Agencies  shall  focus  on  significant  environmental  issues  and  alternatives  and  shall  re¬ 
duce  paperwork  and  the  accumulation  of  extraneous  background  data.  Statements  shall  be  con¬ 
cise,  clear,  and  to  the  point,  and  shall  be  supported  by  evidence  that  the  agency  has  made  the 
necessary  enviromnental  anatyses.  An  environmental  impact  statement  is  more  than  a  disclosure 
document  It  shall  be  used  by  Federal  officials  in  conjunction  with  other  relevant  material  to  plan 
actions  and  make  decisions,  [italics  added] 


An  EIS  can  be  extensive  because  it  thoroughly  examines  the  environmental  consequences  of  a  major  pro¬ 
posed  project  and  all  reasonable  alternatives,  including  the  ‘Do  Nothing’  alternative.  Since  the  EIS  is 
quite  detailed,  it  may  take  up  to  a  year  just  to  prepare  a  draft  EIS  and  it  may  reach  several  hundred  pages 
in  length,  not  including  technical  appendices. 

If,  however,  it  can  be  shown  that  environmental  impact  is  minimal,  an  EA  may  be  prepared  in  lieu  of  a 
fiill-fledged  EIS.  40  CFR  §1501.3  and  §1508.9  describe  the  EA  as  a  “concise  public  document . . .  that 
serves  to  briefly  provide  sufficient  evidence  and  analysis  for  determining  whether  to  prepare  an  [EIS]  or  a 
[FONSI].”  Being  less  detailed  than  an  EIS,  an  EA  may  be  completed  in  significantly  less  time. 

Finally,  the  FONSI,  which  may  be  prepared  after  an  EA  has  been  performed,  merely  states  that  an  action 
“will  not  have  rignifinanf  effect  on  the  human  environment  and ...  an  environmental  impact  statement 
therefore  will  not  be  prepared”  (40  CFR  §1508.13). 

This  research  focused  primarily  on  the  EIS  and  EA  because  they  are  the  most  detailed,  comprehensive, 
and  lengthy  environmental  documents.  E  As  were  included  because  they  can  be  nearly  as  complex  and 

lengthy  as  ETSs  As  Jain  points  out,  the  EA’s  format  “. . .  is  similar  to  that  of  an  EIS - In  the  long  run, 

it  is  desirable  to  use  the  same  general  format  for  an  EA  as  is  used  for  an  EIS”  (Jain  and  others,  1993:  63). 

(1993)  supports  this  idea  ly  pointing  out  that  of  33  federal  agencies  preparing  EISs  in  the  preced¬ 
ing  year,  six  of  those  agencies  (18%)  had  prepared  EAs  first.  Of  those  six  agencies,  five  of  them  always 
prepare  EAs  before  writing  EISs. 


Dennhion  of  ReadabilityAJsability 

Regarding  environmental  documents  themselves,  one  of  the  most  important  issues  addressed  ly  the  CEQ 
Regulation  is  that  cfi  readability.  Readability  has  been  defined  in  a  variety  of  ways.  According  to  Miller 
and  Kintsch  (1980)  as  quoted  ly  Baker  and  others  (1988:  59),  readability  is  “an  interaction  between  the 
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text  and  the  reader’s  prose  processing  capabilities,  rather  than  some  innate  property  of  the  text”  Con¬ 
versely,  Homing  (1993)  defines  it  as  “countable,  objective  features  of  text  per  se Objective  measurement 
of  readability  features  has  been  hotly  debated  for  many  years  (Hanna,  1994)  and  its  validity,  dis(X)unling 
subjective  features  such  as  ‘interestingness’  and  ‘background  knowledge’,  is  suspect  (Anderson  and  Davi¬ 
son,  1988).  More  sinqtly,  Klare  (1963),  as  quoted  in  Gallagher  and  Patrick-Riley  (1989: 85),  defines  read¬ 
ability  as  “the  level  of  difficulty  of  written  text . . .  usually  referenced  at  a  grade  school  level.” 


The  purpose  of  the  readability  requirement  imposed  Ity  the  CEQ  Regulation  is  to  make  emiromnental 
dnrmnfintR  usable  for  decision  makers  and  lay  persons;  thus,  a  mote  comprehensive  definition  of  docu¬ 
ment  usability,  such  as  that  provided  Ity  Guillemette  as  quoted  Ity  Campbell  (1995:  85),  may  be  suitable: 

The  term  usability  refers  to  the  degree  to  which  documentation . . .  can  be  effectively  used  by  tar¬ 
get  readers  in  the  performance  of  tasks  under  environmental  requirements  and  constraints.  Ef¬ 
fectiveness  is  defined  in  terms  of  reader  performance  with  written  materials  and  acceptability  of 
those  materials  to  the  reader.  Basic  human  performance  dimensions  include  efficiency  (speed) 
and  bias(accuracy)  in  performing  tasks.  Readers  themselves  are  the  primary  source  for  reporting 
perceptions  of  tiredness,  discomfort,  boredom,  frustration,  or  excessive  personal  effort  in  using 
documentation.  (Guillemette,  1989:  218) 


For  this  research,  the  working  definition  of  ‘usability’  was  assumed  to  be  the  quality  of  a  document  which 
ftnahtpis  a  laYDcrson  to  read  and  understand  the  information  contained  within  that  document  Duetothe 
lack  of  universal  definition  for  ‘readability’,  the  term  was  considered  to  be  tynonymous  with  ‘usability’. 

The  section  of  the  CEQ  Regulation  (CEQ,  1978)  which  comments  qiecifically  on  the  readability  of  EISs 
applies  equally  well  to  other  environmental  documents: 


§1502.8  Writing 

Environmental  inq)act  statements  shall  be  written  in  plain  language  and  may  use  aiqtropriate 
graphics  so  that  d^sion  makers  and  the  public  can  readily  understand  them.  Agencies  should 
empltty  writers  of  clear  prose  or  editors  to  write,  review,  or  edit  statements,  which  will  be  based 
upon  foe  analysis  and  supporting  data  firom  foe  natural  and  social  sciences  and  foe  environmental 
design  arts. 


Despite  this  regulation’s  requirement  for  clear,  concise,  and  readable  environmental  documents,  prior  re¬ 
search  has  shown  that  many  environmental  documents  are  generally  incomprehensible  to  foe  lay  public 
(Gallagher  and  Patrick-RilQr,  1989;  Weiss,  1989;  Axline  and  Bonine,  1990;  Alciere,  1993;  Gallagher  and 
Jacobson,  1993;  Easterly,  1994).  Although  foe  chapter  entitled  “Preparing  and  Processing  Environmental 
Documents”  in  AFI 32-7061  discusses  foe  preparation  of  environmental  documents,  it  does  not  specifi¬ 
cally  address  foe  readability  aspects  of  foe  documents.  Incorporation  of  40  CFR  §§1502.7-1502.8  into  foe 
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AFI  is  made  simply  Iq?  blanket  adoption  of  the  CEQ  Regulation;  therefore,  the  AFT  does  not  notably  ad¬ 
dress  formatting  elements  which  may  affect  the  readability  of  the  documents. 

Several  different  formatting  elements  are  employed  in  document  design,  also  referred  to  as  ‘page  layout’. 
These  formatting  elements  include  typographical  emphasis,  line  spacing,  indentation,  color,  and  type  size. 
Th^  are  important  because  they  serve  as  ‘guideposts’,  helping  steer  the  reader  through  the  document, 
thus  making  it  more  readable  (Weiss,  1989).  A  lack  of  proper  formatting". . .  discourages  readers.  Some 
are  dissuaded  not  to  read  the  document  at  all,  and  those  that  are  not  dissuaded  become  fotigued,  leading  to 
low  comprehension”  (Gallagher  and  Jacobson,  1993:  99).  Because  AFI  32-7061  does  not  explicitly  direct 
how  the  documents  should  be  formatted,  it  does  not  help  the  USAF  produce  better,  more  readable  EISs. 


Consequences 

The  importance  of  readability  was  aptty  summarized  in  the  introduction  to  the  article  entitled  Aw  Unread¬ 
able  EIS  is  an  Environmental  Hazard: 


Many  F.TSs^  of  course,  ate  written  by  engineers  and  researchers,  without  benefit  of  professional 
“wordsmiths.”  The  engineer’s  notorious  aversion  to  writing  (and  the  unwillingness  of  most  firms 
to  bity  writing  services)  means  that  EISs  are  at  least  as  imreadable  as  most  other  technical  docu¬ 
ments  prepared  by  a  team  of  middling  writers  working  to  an  unforgiving  deadline. 

But,  despite  what  some  consultants  may  think,  the  bad  writing  in  an  EIS  is  much  more  serious 
than  a  mattftr  of  aesthetics;  the  issue  is  not  “English”  or  refinements  of  style.  The  issue  is  the 
quality  of  the  document,  its  usefulness  ur  support  of  the  goals  of  environmental  legislation,  and, 
1^  impliratinn,  the  quality  of  the  environmental  stewardship  entrusted  to  the  scientific  commu¬ 
nity.  (Weiss,  1989: 236) 


The  consequences  of  an  unreadable  document  are  very  real.  For  example,  “[a]  federal  court  issued  a  year¬ 
long  injunction  against  the  entire  federal  chemical  spmy  control  program  to  control  gypsy  moths  because 
the  EIS  was  too  dense  and  technical  to  be  read  and  understood”  (Axline  and  Bonine,  1990;  61).  Time  is 
not  the  only  foctor,  money  and  manpower  costs  are  also  involved.  Axline  and  Bonine  (1990)  provide  an¬ 
other  good  example  in  which  the  Federal  Communications  Commission  (FCC)  had  to  designate  five  full¬ 
time  staff  members  just  to  answer  the  public’s  questions  about  a  pooily  written  regulation.  Since  public  or 
governmental  opposition  to  a  plaimed  action  can  drain  scarce  resources  such  as  time,  monqr,  and  man¬ 
power,  it  becomes  imperative  that  Air  Force  writers  make  environmental  documents  as  readable  as  possi¬ 
ble.  In  order  to  do  this,  writers  will  employ  cohesive  discourse  elements  in  their  documents.  These  ele¬ 
ments  are  described  in  the  following  chapter. 
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III.  Literature  Review 


Prior  Research 

The  unintelligibilify  of  environmeatal  documeats  has  been  attributed  to  many  different  Actors.  Weiss 
(1989)  focused  on  three  types  of  errors,  strategic,  structural,  and  tactical,  committed  during  the  docu¬ 
ment’s  design.  These  errors  are  described  in  Table  2. 


Table! 

Types  of  Errors  Which  Detract  From  Readability  (Weiss,  1989) 


Strategic 

Errors 

Mistakes  of  planning;  feilure  to  understand  why  the  environmental  document  is  being 
written  and  for  whom. 

Examnle:  In  one  part  of  an  EIS  written  for  a  proposed  dam,  the  hydrogeological  as- 
pects  of  the  underlying  soil  and  rock  strata  are  addressed  in  great  technical  detail.  In 
another  part  of  the  same  EIS,  the  botanical  and  zoological  diversity  of  species  is  dis¬ 
cussed;  again  in  great  detail.  No  coimection  is  made  between  the  two  parts. 

Interoretation:  The  EIS,  which  was  probably  written  by  a  team  of  scientists  and  engi- 
neers,  is  unintelligible  to  all  but  the  most  well-educated  layperson.  Even  worse,  the 
reader  who  happens  to  struggle  through  the  technical  detail  doesn’t  sense  the  purpose 
of  the  document.  It  is  sinqily  a  collection  of  fects  about  a  subject. 

Structural 

Errors 

Mistakes  of  organization;  failure  to  arrange  the  elements  of  the  document  in  a  wsty 
that  makes  them  easy  to  follow. 

Example:  A  citizen  reviews  an  EIS  hoping  to  detennine  the  proposed  project’s  most 
important  effect  on  the  site’s  groundwater.  There  is  a  lack  of  typographical  enq>hasis 
(bolding,  italics,  underlining)  to  help  the  reader  find  the  information. 

Interoretation:  Without  typographic  ‘signposts’  to  point  the  way,  the  reader  cannot 
distinguish  the  most  “pointed  and  conclusive  [statements]  firom  the  dense  background 
of  the  page.” 

Tactical  Er¬ 
rors 

Mistakes  of  editing;  feilure  to  test  and  revise  the  text  for  clarity  and  readability. 

Example:  In  her  article.  Alciere  (1993;  263)  provides  a  good  example:  “The  menu 
softw^  is  utilized  to  develop,  organize,  and  display  the  menuing  techniques  used 
within  this  tystem.  Regular  menu-item  nomenclature  appears  (OPERATIONAL)  in 
upper  case  print.  A  menu  item  in  lower-case  indicates  that  the  user  will  have  access  to 
the  item,  but  the  item  is  presently  not  active  at  this  time.” 

Interpretation:  This  passage,  which  was  extracted  firom  a  computer  user’s  manual,  is 
practically  indecipherable  because  it  is  a  clumsy,  awkward,  and  wor(fy  construction  or, 
to  use  Alciere’s  term,  ""Govemmentspeak.” 

Weiss  proposes  that  solutions  to  these  enors  are  attainable.  To  eliminate  strategic  errors,  a  director  with 
‘intellectual  vigor’  can  provide  the  leadership  required  to  manage  the  project  and  coordinate  the  assess¬ 
ment  tftam  Structural  errors  can  be  eliminated  by  employing  professional  document  design  principles  to 
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unify  graphic  elements  and  associated  text  Finally,  tactical  errors  can  be  eliminated  or  controlled  through 
the  efforts  of  a  professional  editor  (Weiss,  1989:  240). 


In  a  similar  discusaon  of  documoit  readability,  Gallagher  and  Patrick-Rilqr  (1989)  evaluated  federal  land 
tnanagfimont  plans  using  the  Flesch  Reading  Ease  Scale.  This  scale  uses  two  objective  measures  (number 
of  words  per  sentence  and  nund)er  of  tyllables  per  word)  to  assign  a  ‘reading  levd’  to  a  text  passage.  This 
m^od  of  measuring  readability  is  refuted  Ity  Anderson  and  Davison  (1988)  as  inappropriate.  They  pur¬ 
port  that  ‘interestingness’  and  dqrth  of  the  reader’s  background  knowledge  are  more  significant  contribu¬ 
tors  to  readability: 


In  mnst  research  on  read^ility  to  date,  very  high  correlations  are  reported  between  the  predic¬ 
tions  of  formulas  based  on  text  features  such  as  word  complexity  and  sentence  length  and  meas¬ 
ures  of  comprehension  associated  with  reading  ability.  We  suggest  that  these  high  correlations 
are  the  Ity-product  of  using  an  inappropriate  statistical  mo^l  which  aggregates  texts  and  readers, 
and  gives  an  exaggerated  impression  of  the  contribution  of  linguistic  fiictors  in  the  tect  to  ease  or 
difficulty  of  comprehension. 


Readers  without  adequate  background  knowledge  for  a  text  find  it  much  harder  to  read  and  un¬ 
derstand  fhan  readers  who  have  the  right  backgroimd  knowledge.  A  text  whose  content  and  way 
of  prfsp^ntiiig  infnrmatinn  are  boring  to  the  reader  is  less  well  understood  than  a  text  which  falls 
within  a  particular  reader’s  interests. 


[I]t  is  not  surprising  that  there  are  maity  factors  about  readers  and  texts  which  cannot  be  de¬ 
scribed  in  terms  of  a  readability  formula.  (Anderson  and  Davison,  1988: 4849) 


fiallaghftr  and  Patiick-Riley  conclude  by  providing  two  recommendations.  First,  the  CEQ  and  Congress 
should  more  clearly  define  (a)  the  purpose  of  the  environmental  document,  (b)  who  the  target  audience  is, 
and  (c)  the  meaning  of  the  term  ‘plain  language’.  Second,  “. . .  each  agency  should  establish  a  defensible 
writing  program  that  describes  the  intended  audience,  the  readability  standards,  and  methods  for  achiev¬ 
ing  those  standards”  (Galla^er  and  Patrick-Riley,  1989).  Referring  to  Weiss’s  list  of  document  readabil¬ 
ity  errors,  it  is  evident  that  Gallagher  and  Patrick-RUey  concentrated  on  strategic  and  tactical  errors. 

Axline  and  Bonine  decry  the  unreadability  of  environmental  documents  by  focusing  on  the  use  of  unintel¬ 
ligible  ‘legalese’  and  indecipherable  technical  jargon,  which  are  synptoms  of  tactical  writing  errors.  They 
concur  with  Gallagher  and  Patrick-Rilq'  in  their  recommendation  to  the  CEQ: 

NEPA’s  tnfnnnatinnal  purposes  cannot  be  met  Ity  documents  that  contain  necsssary  substantive 
information  but  bury  that  information  in  overlong  documents  filled  with  dense  and  technical 
verbiage _ [W]e  urge  the  CEQ  to  strengthen  its  regulations  by  promulgating  enforceable  stan¬ 

dards  governing  the  readability  of  NEPA  documents.  (Axline  and  Bonine ,  1990: 75) 
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In  her  article  ^vo/rf/ng  Gavemmentspeak,  Alciere  (1993)  suHJorts  Axline  and  Bonine  in  their  criticism  of 
nAnftf»n(:iral  language  and  Structure  in  documents.  She  primarily  focuses  on  government  writing,  but  since 
most  EISs  and  EAs  are  written  by  and  for  government  agencies,  her  observations  are  eminently  pertinent 
to  this  research.  She  provides  recommendations  which  fall  into  three  broad  categories:  document  organi¬ 
zation  (structural  errors),  document  length  (strategic  errors),  and  writing  style  (tactical  errors).  In  each  of 
these  she  provides  general  advice  on  how  to  improve  the  document;  however,  she  does  not 

explicitly  address  the  topics  of  cohesion  or  coherence.  The  onty  advice  she  provides  with  respect  to  struc¬ 
tural  errors  is  to  “distinguish  their  outline  from  your  own”,  “downph^r  nuihbered  headings”,  and  “shorten 
the  table  of  contents”  (1993:  262).  These  recommendations  fell  short  by  felling  to  address  qredfic  princi¬ 
ples  of  cohesion  theory,  such  as  the  importance  of  consistency  in  document  development  For  example, 
using  inconsistent  typographic  formats  for  heading  levels  while  reducing  the  Imigth  of  the  table  of  con¬ 
tents  will  not  conect  structural  errors.  Consistency  is  addressed  by  cohesion  theory  in  the  following  sec¬ 
tion,  entitled  Coherence  and  Cohesion. 

Focusing  on  the  typography  of  EISs,  Gallagher  and  Jacobson  evaluated  the  readability  of  150  EISs  which 
had  an  average  length  of  164  pages.  Th^f  observed  that  “(a]t  present  there  is  no  comprehensive  set  of  cri¬ 
teria  specifically  for  EISs  or  similar  large  government  publications”  (1993:  39).  Accordingly,  they  found 
“. . .  a  wide  range  of  quality  in  the  typography  of  EISs”  (1993:  46).  They  emphasize  that  poor  ^pographic 
qxiality,  combined  with  poorly  written  prose,  can  make  an  environmental  document  unreadable  to  an  aver¬ 
age  reader. 

Although  guidance  on  how  to  write  readable  documents  abounds,  some  readers  feel  that  writers  deliber¬ 
ately  fell  to  use  it  because  they  do  not  want  information  in  the  documents  to  be  easily  found,  questioned, 
or  debated  (Weiss,  1989: 236). 

None  of  the  studies  described  in  preceding  paragraphs  couched  their  investigations  or  findings  in  terms  of 
cohesion  theory.  In  an  effort  to  remedy  this  shortcoming.  Easterly  (1994)  investigated  the  impact  of  apply¬ 
ing  specific  principles  of  cohesion  theory  and  document  design  to  selected  sections  of  sample  EISs.  In  her 
experiment,  a  pool  of  readers  answered  short  objective  questions  about  passages  they  had  read  from  sam¬ 
ple  environmental  impact  statements.  She  measured  how  the  presence  or  absence  of  cohesive  discourse 
plpitnftnfs  affected  the  subject’s  performance.  The  dependent  variables  were  accuracy  (number  of  correct 
responses  to  questions  testing  comprehension  of  the  EIS)  and  efficiency  (time  it  took  the  subject  to  answer 
the  questions).  Unfortunately,  her  results  showed  no  statistical  significance  between  or  among  the  differ¬ 
ent  treatments. 
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This  research,  like  Easterly’s,  will  focus  on  the  second  type  of  enor  identified  by  Weiss  in  Table  2  - 
structural  error.  Where  Easterly  investigated  how  the  presence  or  absence  of  cohesive  elements  affected 
the  reader’s  objective  performance  on  simple,  measurable  tasks,  this  research  wiU  explore  the  reader’s 
perception  of  a  document’s  usability  using  the  subjective  data  Easterly  collected  during  the  course  of  her 
experiment  Before  this  can  be  done,  however,  several  topics  in  cohesion  theory  and  document  design 
must  be  examined. 

Coherence  and  Cohesion 

Pg«si»ntial  to  the  readability  of  a  document  are  the  concepts  of  coherence  and  cohesion.  Campbell  (1995) 
investigated  these  principles  and  defined  several  terms.  A  coherent  document  “. . .  is  one  in  which  [the 
reader]  perceives  continuity,  as  well  as  adequacy,  accuracy,  and  clarity.”  Coherence  is  the  global  or  holis¬ 
tic  perception  of  continuity,  adequacy,  accurary,  and  clarity,  and  is  alwtys  related  to  the  meaning  of  the 
discourse.  For  example,  a  reader’s  perception  that  an  EIS  is  incoherent  means  that  the  reader  cannot  un¬ 
derstand  the  meaning  of  the  EIS. 

Similarly^  but  not  identically,  a  cohesive  document  is  one  in  which  a  writer  “. . .  has  established  continuity 
through  the  use  of  similar  and  proximate  discourse  elements.”  Cohesion  can  be  either  a  global  or  a  local 
perception  and  may  or  may  not  be  directly  related  to  meaning.  Similar  synoityms,  such  as  ‘roads’  and 
‘highwtys’,  in  consecutive  sentences  are  cohesive  and  related  to  meaning,  while  similar  typeface  (e.g., 
italir  boldface)  in  consecutive  headings  is  cohesive  but  clearly  not  related  to  meaning. 

Discourse  elements  are  defined  as  “any  of  the  full  range  of  conqxjnents  that  appear  in  [oral  or  written] 
communication”  and  are  divided  into  two  categories:  linguistic  and  non-linguistic.  Non-linguistic  dis¬ 
course  plMUPOTts  are  finther  separated  into  two  subcategories;  auditory  and  visual.  Table  3  illustrates  the 
definition  of  discourse  elements  and  provides  simple  examples. 
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Tables 

[Partial]  List  of  Elements  That  May  Be  Involved  in  Creation  of  Discourse  Unity, 
Along  With  Representative  Examples  of  Each  Type  (Campbell,  1995;  13) 


NONLINGUISTiC 


VISUAL 

example 

AUDITORY 

example 

Typography 

italic  print 

Pitch 

deep  tone 

Geometric  Shape 

rectangular  bar  in 
graph 

Rhythm 

^ccato 

Picture/  Drawing 

photograph 

Color 

blue  background 

Grapheme 

p  (Greek  “beta**) 

Body  Gesture 

“ok"  hand  sign 

LINGUISTIC 

PHONOLOGICAL 

example 

MORPHO/ 

SYNTACTIC 

example 

SEMANTIC 

example 

Initial  Segment 

/W  in  “bror' 

Voice 

money  "was  stolen” 
(passive) 

Synonymy 

"cat”  &  "feline" 

Coda 

/ox/  in  "box” 

Tense/Aspect 

money  "has  disap- 
peared"  (past  perfect) 

Overlap 

"cat”  &  "kitten" 

Stress 

/e!/  in  "boxelderi’ 

Gender/Number 

"she"  quit 
(feminine,  singular) 

Hyponymy 

"car  &  "animar 

Phrase/Clause 

Structure 

"in  the  garden” 
(prepositional  phrase) 

Antonymy 

"animal",  "mineral",  & 
"vegetable" 

Cohesion  is  what  makes  a  document  “easy  to  foUow”  (Weiss,  1989;  236),  thus  reducing  structural  error 
and  promoting  coherence.  The  primary  difference  between  coherence  and  cohesion  is  the  manner  in 
which  ‘continuity’  is  expressed.  Since  coherence  is  dependent  solely  upon  the  readsfs  perception,  it  is 
difficuU  to  describe  coherence  and  even  more  difficult  to  assure  it.  Good  writers  go  to  great  lengths  to 
malfp.  their  doctunents  as  coherent  as  possible,  but  they  can  never  be  certain  that  the  exact  message  they 
are  trying  to  conv^  will  reach  the  reader  intact.  If  all  the  elements  requisite  for  umly  are  present  and  the 
reader  perceives  the  same  message  sent  by  the  writer,  then  the  document  is  considered  coherent. 

The  Amelia  Bedelia  series  of  children’s  books  make  light  of  misperceived  messages  and  serve  as  good  ex¬ 
amples  of  how  discourse,  seemingly  coherent  and  unambiguous  to  the  reader,  can  be  iimocently  misinter¬ 
preted  ly  a  receiver.  In  the  bode  Merry  CAns/mos,  Amelia  Bedelia,  Amelia  is  a  housdeeeper  working  in 
the  Rogers’  home  before  Christmas.  Mrs.  Rogers  asks  Amelia  to  make  some  popcorn  for  popcorn  balls . . 

“How  much  should  I  p<q)?”  said  Amelia  Bedelia. 

“I’ll  need  six  cups,”  said  Mrs.  Rogers. 
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Amelia  Bedelia  went  to  the  kitchen . . .  [and] . . .  measured  six  cups  of  com.  Then  she  popped 
and  she  popped  and  she  popped. 

“Mrs.  Rogers  must  love  popcorn  balls  ”  said  Amelia  Bedelia 


[Mrs.  Rogers  comes  into  the  kitchen  and  sees  seven  huge  pots,  pans,  and  bowls  brimming  over 
with  mfnmrifi  of  popcom.  Amelia  Bedelia  looks  proud  of  herself,  but  Mrs.  Rogers  looks  flabber¬ 
gasted.] 

“Amelia  Bedelia!”  she  said.  “Why  did  you  pop  so  much  com?  I  only  need  six  cups.” 

“And  I  popped  six  cups,”  said  Amelia  Bedelia. 

“I  meant  six  cvqs  of  popped  com,”  said  Mrs.  Rogers. 

“Then  you  should  have  said  so,”  said  Amelia  Bedelia.  (Parish,  1986;  8-21) 

The  discourse  between  Mrs.  Rogers  and  Amelia  Bedelia  seemed  sinq>le  enough,  but  the  literal-minded 
housdreeper  did  not  perceive  the  same  message  that  Mrs.  Rogers  thought  she  had  sent  The  message 
lacked  coherence  simply  because  the  receiver,  Amelia  Bedelia,  didn’t  perceive  the  message  as  it  was  in¬ 
tended  I9  the  sender. 

T  .ilcfi  coherence,  cohesion  is  a  psychological  entity,  however,  cohesion  is  more  easily  identified  than  coher¬ 
ence  because  it’s  cues  are  manifested  ‘physically’  within  the  document  itself.  For  example,  a  reader  can 
see  that  similar  heading  levels  have  similar  appearance  and  that  the  space  between  paragraphs  is  greater 
than  the  space  between  lines  within  a  paragraph.  However,  not  all  cohesive  cues  are  purely  plq^sical.  For 
example,  although  a  cohesive  series  of  noun  phrases  may  all  begin  with  gerunds  as  cues  (“managing”, 
“reviewing”,  “budgeting”,  etc.),  gerunds  are  not  ‘pt^fsical’  things;  thq^  are  a  cognitive  entity  and  exist  in 
the  mind  of  the  reader.  Still,  the  reader  can  sense  these  cohesive  cues  and  recognize  order  and  sttucture  in 
the  discourse. 

While  coherence  is  related  to  meaning,  cohesion  is  related  to  fitrm  and  structure.  An  interesting  point  of 
illustration  is  the  feet  that  a  reader  can  detect  cohesion  between  discourse  elements  without  being  required 
to  understand  content  of  a  discourse  at  all.  As  Easterly  ejqtlained,  “a  10-year-old  might  find  an  EIS  un¬ 
clear  (hence  incoherent)  despite  the  feet  that  the  EIS  writer  has  placed  certain  cohesive  elements  in  the 
document’  (1994:  18).  By  w^  of  illustration,  books  about  desktop  publishing  often  use  “Greek  text”,  a 
random  combination  of  letters  that  have  no  meaning,  to  show  basic  layout  and  spacing  (Groff,  1990).  An 
example  is  shown  in  Figure  1 : 
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7  HOUR 
SALE! 

Special  Savings,  Sheets  Slashed  50% 


Percalghtvgdaew 

SaddT  lied  fdeeftid  sale  sdf  «idg 

fttf  fidMr  sdh  foiejnsi  nshdf. 

Percal^tvgdaew 

SBddr  Ited  r(teelhd  safe  ItHTg  sdf  aadg 

fWftehfr  sdh  foiejnsi  risiidf. 

Percalglhtvgdaew 

SaddT hedfdeefhd  safe  sdf  aadg 

fdfffehtrsdhToie^sinshdf. 

Percalghtvgdaew 

Saddf  lied  fdeeftid  safe  feffg  sdf  aadg 
fdffteMr  sdh  foiejnsi  fishdf. 

Percalghtvgdaew 

Saddf  lied  fdeeftid  safe  feffg  sdf  aadg 

Mf  fiehlr  sdh  fotejnd  rishdf. 

Percalghtvgdaew 

Saddf  lied  fdeeftid  safe  fef^  sdf  aadg 
fdfflehtr  sdh  foiejnsi  rishdf. 


$00 

Percd^vgdaaw 

Saddf  tied  fdeeftid  safe  fefljg  sdf  aadg 
fdf  fiehlr  sdh  foiejnsi  rishdf. 

$00 

$00 

Percal^tvgdBew 

Saddf  lied  fdeeftid  safe  fefrg  sdf  aadg 
fdf  fiehlr  sdh  foiejnsi  rishdf. 

$00 

$00 

Percal^tygdaew 

&ddr  lied  fdeeftid  safe  fefl|g  sdf  aadg 
fdffiehtr  sdh  ftfiejnsl  rishdf. 

$00 

$00 

Pdfcal^vgdaew 

Saddf  lied  fdeeftid  fei^  sdf  aadg 

fdf  fiehtr  sdh  foiejnsi  ri^df. 

$00 

$00 

Perca^vgdtiew 

Saddf  lied  fdeeftid  safe  feffg  sdf  aadg 
fdf  fiehtr  sA  foiejnsi  rishdr. 

$00 

$00 

Percalghtvgdaew 

Saddf  lied  fdeeftid  safe  feffg  sdf  aadg 
fdf  fiehtr  s  A  f(4^  rishdr. 

$00 

store  Hours  /-xr'  r 

9  am  to  4  pm  £A\jlPplt 

Swaedscr  vxzfs 
saedseafw 
asdMreghgh 


Figure  1.  Example  of  ‘^reek  Text”  Used  for  Cohesive  Structuring  (GroflF,  1990) 


Although  most  of  the  text  used  in  this  fictitious  sales  advertisement  is  unintelligible  gobbledygook,  it  still 
demonstrates  a  rea^zable  structure.  It  is  apparent  that  several  different  items  are  on  sale,  they  are 
probably  similar  in  fimction,  and  there  is  a  short  description  of  the  item  below  its  main  heading.  The  ad¬ 
vertisement  ^ipears  cohesive,  even  though  the  details,  such  as  the  merchandise  descriptions  and  prices, 
are  almost  entirely  incoherent. 


Gestalt  Continuity 


In  Chapter  2  of  her  book,  Campbell  (1995)  explains  her  view  of  coherence  from  the  recipient’s  perspec¬ 
tive.  She  brings  together  the  concept  of  continuity,  as  defined  by  the  Gestalt  school  of  ptychology,  and  the 
concept  of  coherence,  as  investi^ted  Ity  H.  Paul  Grice  in  his  work  on  discourse  unity. 

The  Gestalt  school  of  psycholo^r  emerged  firom  a  group  of  European  psychologists  including  Kurt  KofiBra, 
Wolfgang  Kohler,  and  Max  Wertheimer,  who  opposed  the  narrow,  ‘atomistic’,  view  of  psychology  estab- 
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listed  by  the  19lh  century  ‘father  of  psychology’,  Wilhelm  Wundt  (Elkind,  1994).  The  members  of  the 
new  school  contended  that: 

[T]he  atomistic  approach  [to  psychology]  could  never  lead  to  the  understanding  of  major  psycho¬ 
logical  phenomena.  A  symphony,  they  argued,  is  more  than  the  sum  of  its  individual  notes.  The 
form  (Gestalt)  of  anything  has  qualities  that  are  different  from,  and  that  carmot  be  attributed  to, 
the  sum  of  its  parts. 

To  siqjport  their  argument,  the  Gestalt  p^chologjsts  focused  on  perception.  They  demonstrated 
that  perception  is  organized  into  holistic  rather  than  atomistic  components.  Perception  is  organ¬ 
ized  into  &e  figure,  such  as  a  soloist  playing  a  concerto,  arrd  the  ground,  the  orchestral  accom¬ 
paniment.  Visually  too  the  perception  of  the  observer  is  centered  on  the  soloist  and  the  conductor, 
who  are  the  figures,  and  the  orchestra,  which  is  the  ground.  (Elkind,  1994) 

Campbell  (1995)  explains  cohesion  theory  in  terms  of  the  Gestalt  concept  of  continuity.  This  theory  ac¬ 
counts  for  the  human  mind’s  natural  tendency  to  groig)  things  that  are  stmilar  and  proximate  (see 
Wertheimer,  1938;  Easterly,  1994;  and  Carrqrbell,  1995,  for  more  detailed  descriptions). 

Grice’s  Maxims 

H.  Paul  Grice  categorized  four  discourse  factors  {relation,  quantity,  manner,  quality)  to  describe  what  re¬ 
cipients  assume  about  coherent  discourse  and  explain  why  discourse  can  be  perceived  as  coherent  despite 
a  lack  of  explicit  or  logical  connections  between  participants’  contributions.  Provided  that  discourse  par¬ 
ticipants  are  cooperating  (actually  trying  to  communicate  with  each  other),  recipients  can  make  sense  of 
less-than-adequate  contributions  through  implicature.  Implicatures  (unstated  and  not  logically  necessary 
meanings)  are  created  ly  the  recipient  in  order  to  build  a  bridge  that  connects  seemingly  unconnected 
contributions. 

Grice  established  mayims  for  each  discourse  fector  which,  if  flouted  (intentionally  or  accidentally  vio¬ 
lated),  would  require  the  recipient  to  manufacture  an  implicature  in  order  to  derive  meaning  from  the  dis¬ 
course.  The  following  descriptions  are  taken  from  Carrqrbell  (1995)  and  Paiicer  and  Riley  (1994): 

Majdm  of  Rdation 

Each  participant’s  contribution  should  be  relevant  to  the  subject  of  discourse.  A  contribution  may  appear 
to  be  irrelevant  to  eariier  contributions  if  this  maxim  is  flouted.  For  example,  if  a  student  asks,  “Is  profes¬ 
sor  Smith  in  her  ofircer  and  the  secretary  replies,  “Her  car  isn’t  in  the  parking  lot”,  then  the  secretary 
has  flouted  the  Maxim  of  Relation.  Because  the  student  assumes  the  secretary  is  being  cooperative  (not 
deliberately  stying  something  irrelevant),  the  only  way  the  student  can  make  sense  of  the  secretary’s  am- 
tribution  is  to  aggnmR  that  the  seemingly  irrelevant  (i.e.,  the  location  of  the  professor’s  car)  is  actually 
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relevant  (i.e.,  the  professor  drives  a  car  to  work  but  her  car  is  not  here;  therefore,  the  professor  must  not  be 
here).  Although  the  secretary  hasn’t  directly  said  so,  the  student  creates  the  implicature  that  the  professor 
is  not  in  her  office. 

Maxim  of  Quantity 

Each  participant’s  contribution  should  be  just  as  informative  as  required.  Otherwise,  a  contribution  may 
appear  to  offer  too  little  or  too  much  information.  For  example,  if  a  wife  adrs  her  husband,  “Where  are 
you  going?”  and  he  answers,  “Out”,  then  the  husband  has  flouted  the  Maxim  of  Quantity.  Although  he 
hasn’t  directfy  said  so,  the  wife  may  create  the  implicature  that  the  husband  is  angry  and  doesn’t  want  to 
answer  any  more  questions. 

M(vdm  of Manner 

Each  participant’s  contribution  should  be  expressed  in  a  reasonably  clear  fashion;  otherwise  it  may  appear 
to  be  too  obscure  or  indirect  For  example,  if  a  principal  asks  one  of  her  first  grade  teachers,  in  the  pres¬ 
ence  of  the  students,  “Is  ai^lhing  special  happening  in  your  classroom  this  afternoon?”  and  the  teacher  re¬ 
sponds,  “Es-yay,  ania-say  aus-c%  is-way  oming-cay  oo-tay  ass-clay”,  then  the  teacher  has  flouted  the 
Maxim  of  Manner.  Since  the  teacher  used  Pig  Latin  (“Yes,  Santa  Claus  is  coming  to  class.”),  which  he  as¬ 
sumes  the  children  don’t  understand,  the  principal  may  create  the  implicature  that  the  teacher  does  not 
want  the  her  to  tell  the  children  about  the  surprise. 

Mcodm  of  Quality 

Each  participant’s  contribution  should  be  truthful  and  based  on  sufficient  evidence;  otherwise,  it  m^  ap¬ 
pear  inaccurate.  For  example,  if  a  student  asks  his  thesis  advisor,  “Do  I  have  a  shot  at  the  thesis  award?” 
and  she  replies,  “Sure-  when  pigs  fly”,  then  she  is  flouting  the  Maxim  of  Quality.  The  student  would 
create  the  implicature  that  she  thinks  the  probability  of  his  winning  the  thesis  award  is  less  than  infini¬ 
tesimal. 

The  lack  of  cohesive  discourse  elements  in  an  environmental  document  can  violate  Grice’s  Maxims  and 
prompt  readers  to  create  implicatures  the  writer  may  not  have  intended.  Recall  Weiss’s  statement  that 
some  readers  feel  writers  deliberately  make  environmental  documents  unreadable  because  they  do  not 
want  information  in  the  documents  to  be  easily  found,  questioned,  or  derated  (1989: 236).  This  could  be 
an  implicature  created  in  the  readers’  minds  to  explain  the  flouting  of  one  or  more  of  Grice’s  Maxims. 

The  purpose  of  this  thesis  was  to  examine  how  the  manipulation  of  certain  discourse  elements  affect  read¬ 
ers’  perceptions  of  document  usability.  These  perceptions  were  viewed  in  the  context  of  Grice’s  Maxims. 
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The  discourse  elements  manipulated  in  the  experiment  (typography,  white  space,  tense,  and  syntax)  are 
described  in  the  following  sections. 

Visual  (Non-Linguistic)  Cues 

Discourse  elements  can  serve  as  cues  to  establish  discourse  unity.  Typography  and  white  space  are  two 
types  of  visual,  non-linguistic,  discourse  elements  which  can  help  create  discourse  unity.  Although  white 
space  was  not  i^pecifically  listed  in  Table  3  on  page  13,  its  importance  as  a  discourse  element  should  not 
be  underestimated.  Both  typography  and  white  space  guide  the  reader  along  the  document  and  contribute 
to  tv^hfisinn  These  two  elements  ate  described  below.  Two  types  of  linguistic  discourse  elements,  tense 
and  tyntax,  are  described  in  the  following  sectiotL 

Typography 

Typography  refers  to  the  general  character  and  appearance  of  printed  matter,  such  as  the  size  and  shape  of 
the  letters  used  in  text,  headings,  captions,  and  grrqrhic  elements.  The  term  typeface  refers  to  the  shape  of 
characters;  i.e.,  serif  (the  ‘feet’  on  the  ends  of  the  main  strokes  of  the  letters  in  this  typeface),  sans  serif 
(without  feet),  or  script  (appearing  as  handwritten),  and  is  interchangeable  with  the  iamfont  (Groff, 
1990). 

Within  each  typeface  or  font,  several  different  methods  of  creating  special  effects  are  available.  Taken  to¬ 
gether,  these  qrecial  ^fects  create  typefece  families.  Special  effects  include  bolding  and  italicizing,  as  well 
as  combinations  <rf  both.  Typeface  families  can  be  further  enhanced  Ity  underlining  or  the  use  of  different 
colors;  however,  environmental  documents  are  seldom  printed  or  reproduced  in  more  than  one  color.  In 
fact,  fiatlaghftr  and  Jacobson  (1993)  specifically  recommend  that  colors  other  than  black  ink  on  white  pa¬ 
per  not  be  used. 

The  last  aspect  of  typography  to  be  addressed  is  that  of  size.  Groff  explains: 

While  horizontal  measurements  can  be  done  in  inches  as  well  as  picas  and  points,  vertical  meas¬ 
urement  is  almost  always  done  in  points.  A  pica  contains  12  points.  There  are  6  picas  or  72 
points  to  the  inch.  A 10  point  font  is  10  points  hi^  from  the  top  of  the  “1”  to  just  a  little  below 
the  bottom  of  the  “y”.  (1990;  32) 

By  way  of  illustrating  the  concqrt,  the  reader  should  note  how  typography  has  been  errqrloyed  throughout 
this  thesis  in  an  attempt  to  create  textual  cohesion.  Primary  headings  are  printed  in  14  point  Arial  bold 
font,  secondary  hfaHings  iu  12  point  Arial  bold  italic,  tertiary  headings  in  12  point  Times  New  Roman 
bold  iinttpirlinp;  and  quaternary  headings  in  12  point  Times  New  Roman  bold  italic.  In  addition  to  heading 
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lypograplty,  italics,  bolding,  and  underlining  have  been  used  throughout  this  thesis  to  highlight  important 
points.  Several  dififerent  ^TpogKq)hic  special  effects  can  be  seen  in  Table  2  on  page  9. 

Heading  typograpl^  is  especially  important  for  generating  cohesion  when  designing  documents.  As  K^es 
points  out,  “[tlypographical  cueing  signals  hierarchy  and  simple  information  types.  Typographic  cueing 
creates  a  visual  ffamewoik  for  information  and  relationships  on  the  page”  (1993: 653).  Non-cohesive  ty¬ 
pographic  cueing  in  section  headings  can  mask  relationships,  obfuscate  information  hierarchies,  and 
confuse  the  reader,  therefore,  one  of  the  visual  discourse  elements  explored  in  this  study  is  heading  typog¬ 
raphy.  This  study  examined  how  the  presence  or  absence  of  cohesive  heading  typogr^hy  affected  read¬ 
ers’  perceptions  of  document  usability.  Another  visual  cue  that  is  examined  is  white  space,  which  is  de¬ 
scribed  in  the  next  sub-section. 

White  Space 

The  other  type  of  visual,  non-linguistic,  discourse  element  manipulated  in  Easterly’s  study  was  white 
space.  White  space  refers  to  the  amount  and  location  of  space  between  and  around  text  and  figures.  Gal¬ 
lagher  and  Jacobson,  quoting  Felker  and  others  (1981;  81),  state  that  white  space  “is  as  much  an  element 
in  the  design  of  a  document  as  the  type  itself”  (1993;  102).  White  space  is  affected  by  such  fectors  as 
margin  size,  paragraph  spacing,  line  spacing,  letter  spacing,  indenting,  and  spacing  between  columns 
(fiallaghar  and  Jacobson,  1993).  Several  researchers  (Tinker,  1%5;  Hartley,  1985;  and  Baird  and  others, 
1987)  are  cited  by  Gallagher  and  Jacobson  (1993)  as  recommending  that  no  more  than  50%  of  a  page 
should  be  covered  with  text  or  graphics. 

Most  of  the  terms  used  when  describing  white  space  are  familiar  to  the  casual  reader,  i.e.,  margins,  col¬ 
umn  spacing  line  spacing,  and  indentation.  Three  terms  which  may  be  un&miliar  are  leading,  kerning, 
and  gutters,  but  they  are  easily  explained. 

The  space  between  lines  of  text  is  referred  to  as  leading  and  is  measured  in  points  (Groff,  1990;  32).  A 
HnnimMit  printed  in  a  double-spaced  12  point  font  contains  12  points  of  leading  between  the  lines  of  text. 
Similarly^  if  it  were  printed  in  a  double-spaced  10  point  font,  there  would  be  10  points  of  space  between 
the  lines.  If  the  text  were  single-spaced,  there  would  be  no  leading  between  the  lines. 

Adjusting  the  space  between  individual  letters  is  called  kerning  (Groff  1989;  36).  Kerning  is  used  because 
some  pairs  of  letters  (e.g.,  ‘To’,  ‘Fi’,  and  ‘Ve’)  have  awkward  spaces  and  look  out  of  balance  when  com¬ 
bined,  as  illustrated  in  the  exanqjle  below,  lypefeces  which  do  not  use  kerning  are  termed 
‘nonproportional’.  The  following  two  lines  demonstrate  the  difference  between  a  proportional  (kerned) 
font  and  a  nonproportional  (unkemed)  font: 
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This  line  is  printed  in  10  point  Times  New  Roman,  which  is  a  proportional,  kemed  font.  Com¬ 
pare  the  letter  combinations  ‘To’,  ‘Fi’,  and  ‘Ve’,  to  the  line  below. 

This  line  is  printed  in  10  point  Courier  New,  which  is  a  nonpro¬ 
portional,  unkerned  font.  Compare  the  letter  combinations  'To', 
'Fi' ,  and  'Ve' ,  to  the  line  above. 


Note  that  although  both  fonts  are  printed  at  the  same  point  size,  the  nonproportional  font  requires  more 
space. 

The  term  gutter  is  analogous  to  the  term  margin  in  that  it  describes  the  amount  of  space  between  vertical 
columns.  The  following  ‘Greek  text’  is  printed  in  two  column  format,  with  a  one-half  inch  gutter  between 
the  columns: 


The  shdkfo  she  oouth  sidn  flsndln  shf 
Fheosn  raidkn,  sdjf  sel,  aldwleif  fhtllein  si 
sldnyui^on  sn  wedn.  Ins  esln  ths  sdinwl  shrk  1 
^fwlek  sdhdo  wqpojha  sdlkdna  aodj  sjhsl  dopq. 

Fheosn  raidkn,  sdjf  sel,  aldwleif  fhtllein  si 
sldnn  sn  wrerhedn.  Ins  esln  ths  sdinwl  sind 
Gmyl  sdknf  pmx  hwkjc  sii  sash  wioa;  sdntto  si 
wpoioqk  skenf,  snsno  hnhol  koi.  Zdank  murf  lisr 
shyl  asdmip  iwlkem. 


The  shdkfo  she  ytoouth  sidn  flsndln  shf. 
Fheosn  rayioidkn,  sdjf  sel,  aldwleif  fhtllein  si 
slyudim  sn  wedn.  Ins  esln  ths  sdinwl  shrk  asdl 
sjfwlek  sdhdyo  wqpojha  sdlkdna  aodj  i^hsl  dopq. 
Nsdon  sidsosh  sdnn  si  wlhs  sswo  sind  pmxh'nigc 
sii  sash  wioa;  sdntto  si  wo  qk  sken^  snsno  hnhol 
koi. 

Nsdon  sidsosfh  fh  sdnn  si  wlhs  sswo  sind 
pm  xhwkjc  sii  sash. 


The  visual,  non-linguistic,  discomise  elements  of  typography  and  white  space  can  help  create  discourse 
unity  1^  guiding  readers’  eyes  along  the  page,  giving  them  a  place  to  rest,  emphasizing  important  points, 
and  ‘clumping’  thoughts  together  is  a  structured  manner  (Grofif,  1990).  For  example,  the  consistent  use  of 
boldface  letters  of  the  same  font  and  size  to  set  off  the  different  sections  of  this  thesis,  as  well  as  the  extra 
white  space  provided  between  sections  and  subsections,  is  intended  to  improve  the  cohesion  of  the  docu¬ 
ment. 

This  study  examined  the  cohesive  employment  of  visual  discourse  elements  in  environmental  documents, 
specifically  heading  typography  and  white  space,  to  see  how  they  affected  readers’  perceptions  of  docu¬ 
ment  usability.  In  addition  to  these  two  non-linguistic  discourse  elements,  this  study  examined  two  lin¬ 
guistic  discourse  elements  which  ate  described  in  the  next  section. 

Linguistic  Cues 

T  .ingiiigrie  discourse  elements,  like  non-linguistic  discourse  elements,  can  serve  as  cues  to  establish  dis¬ 
course  unity  when  used  cohesively.  Tense  and  syntax  are  two  types  of  linguistic  discourse  elements  which 
can  serve  this  purpose.  They  are  described  below. 
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Tense 


Tense  refers  to  the  time-reference  of  the  verbs  in  a  sentence,  such  as  past,  present,  and  future.  It  must  be 
used  consistently  and  coherently  in  order  for  the  reader  to  be  able  to  understand  the  sequence  of  events. 
Consider  this  sequence  of  three  sentences,  “Loimy’s  dog  gave  birth  to  three  puppies.  One  of  them  is  lick¬ 
ing  my  hand.  I  will  take  the  piqrpy  home  with  me.”  This  series  of  sentences  makes  sense  because  tense 
was  used  correctly.  If  tense  had  been  used  iircorrectly,  the  sentences  may  have  read,  “Lome’s  dog  will 
give  birth  to  three  puppies.  One  of  them  is  licking  my  hand.  I  have  taken  the  piqrpy  home  with  me.”  How 
could  one  of  the  puppies  lick  a  hand  if  it  had  not  been  bom  yet?  Similarly,  how  could  a  prqrpy  have  been 
talff»n  home  if  it  was  not  yet  bom?  Clearly,  inqrroper  and  inconsistent  use  of  tense  can  confuse  the  reader 
and  reduce  discourse  unity. 

Syntax 

Syntax  refers  to  the  structure  of  sentences.  Specific  syntactic  rules  exist  for  eveiy  language  and  sentences 
that  do  not  follow  those  rules  are  termed  ‘ ill-formed’ .  That  is  not  to  say,  however,  that  one  idea  cannot  be 
expressed  through  different  syntactic  forms.  For  exanq)le,  passive  and  active  sentences  can  convey  the 
saitifi  mfaning  by  using  different  syntactic  forms.  The  sentence  “Sarctya  gave  me  a  ride  to  school”  is  writ¬ 
ten  in  active  form,  but  it  could  just  as  easily  been  written  is  the  passive  form,  “I  was  given  a  ride  to  school 
by  Saroya.” 

The  term  ‘syntactic  parallelism’  refers  to  sequences  of  sentences,  phrases,  or  clauses  that  follow  the  same 
syntactic  form.  Lack  of  parallelism  is  especially  noticeable  in  lists.  For  example,  consider  the  following 
statement;  “Duties  of  the  environmental  engineer  include;  (1)  writing  environmental  inqract  statements, 
(2)  reviewing  contractor-prepared  reports,  and  (3)  managing  the  budget  for  the  environmental  office.” 

This  sequence  of  noun  phrases  is  written  in  parallel  form,  using  gerunds  to  begin  the  phrase  and  including 
an  object  of  the  action.  Iliis  sentence  establishes  cohesion  through  the  consistent  use  of  syntactic  cues. 
Conversely,  the  following  sentence  does  not;  “Duties  of  the  environmental  engineer  include;  (1)  writing 
enviromnental  inq>act  statements,  (2)  contractor  r^rts  will  be  reviewed,  and  (3)  she  will  manage  the 
budget  for  the  environmental  office.”  This  sentence  sounds  awkward  due  to  its  lack  of  cohesive  tyntactic 
cues.  Thus,  discourse  unity  can  be  enhanced  by  using  parallel  or  similar  syntactic  forms  which  are  cohe¬ 
sive,  while  using  dissimilar  forms  adversely  affect  cohesion,  reducing  discourse  unity. 

Summary 

This  chapter  opened  by  relating  how  prior  researchers  identified  problems  with  the  usability  of  environ¬ 
mental  impact  documents.  It  then  described  how  Easterly  focused  on  the  particular  problem  of  structural 
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error,  which  is  the  failure  to  arrange  elements  of  a  document  in  a  way  that  makes  them  ea^  to  follow.  The 
reader  was  then  introduced  to  the  concepts  of  coherence,  cohesion  theory,  and  Grice’s  Maxims  of  coherent 
discourse  (relation,  quantity,  manner,  and  quality).  Finally,  the  specific  discourse  elements  which  were 
manipulated  in  Easterly’s  experiment  (typography,  white  grace,  tense,  and  tyntax)  were  described.  The 
next  chapter  will  explain  how  Easterly’s  experiment  was  designed  and  administered,  arrd  how  this  stucty 
evaluated  the  subjective  data  obtained  firom  that  experiment. 
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IV.  Methodology 


Easterly  investigated  the  application  of  several  principles  derived  from  cohesion  theory  to  affect  improve¬ 
ments  in  the  readability  of  EISs  (1994).  A  total  of  eight  different  combinations  of  treatments  were  investi¬ 
gated  with  32  subjects  teted.  She  collected  both  objective  data  and  subjective  data. 

The  objective  data  were  measurements  of  accuratty  and  efficiency.  Accuracy  was  defined  as  the  munber  of 
ritnpis  sutgects  correctly  responded  to  objective  short-answer  questions  and  efficiency  was  deGned  as  the 
time  it  took  the  subjects  to  answer  these  questions. 

The  subjective  data  were  measurements  of  subject’s  perceptions  of  document  usability.  Because  it  was  be¬ 
yond  the  scope  of  her  effort.  Easterly  did  not  evaluate  this  data.  The  purpose  of  this  thesis  is  to  explore  the 
subjective  data  and  determine  if  there  is  a  statistically  significant  difference  in  the  readers’  perceptions  of 
the  document’s  usability  based  on  the  presence  or  absence  of  cohesive  discourse  elements. 

This  rihapfftr  will  begin  by  describing  how  the  overall  ejqieriment  was  designed.  It  will  then  give  a  brief 
demographic  outline  of  the  subjects.  Next,  it  will  explain  how  the  sample  EIS  sections  were  prepared,  how 
the  experiment  was  administered,  and  how  the  data  was  analyzed. 

Experiment  Design  Overview 

Sections  erf  actual  sample  EISs  were  prepared  with  modifications  to  certain  discourse  elements  within  the 
documents.  Specifically,  the  linguistic  (syntax  and  tense)  and  visual  (white  space  and  typography)  cues 
were  altered.  A  sanqile  population  reviewed  these  modified  documents,  as  well  as  some  documents  which 
had  not  been  modified.  The  subjects  were  tested  for  level  of  comprehension  as  well  as  time  taken  to  un¬ 
derstand  concepts  at  a  predetermined  level.  Also,  thq^  provided  feedback  regarding  the  usdiility  of  the 
afininiCTit  Finally,  the  data  was  statistically  analyzed  to  determine  how  these  modifications  affected  EIS 
readability. 

Easterly  evaluated  the  objective  data  related  to  the  subjects’  comprehension  level  and  the  time  taken  to 
yn/tarstaTMi  concepts  (1994).  This  study,  on  the  other  hand,  evaluated  the  readers’  subjective  feedback  re¬ 
garding  the  usability  of  the  document 

Subjects 

The  32  subjects  selected  Ity  Easterly  for  this  experiment  were  all  emplctyees  of  an  Air  Force  organization. 
Data  from  two  of  the  subjects  had  to  be  discarded  because  they  did  not  correctly  complete  the  Scantron  an- 
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swer  forms  and  it  was  impossible  to  determine  which  answers  corresponded  with  which  questions;  there¬ 
fore,  data  from  only  30  subjects  were  evaluated  in  this  thesis. 

On  the  average,  the  subjects  had  at  least  a  bachelor’s  degree,  were  mature,  and  were  familiar  with  techni¬ 
cal  and  sriftnrifie  terms.  Summaries  of  subject  demographics  are  shown  in  Figure  2  through  Figure  5. 


13 


Figure  2.  Subject  Demographics:  Age  (Easteriy,  1994) 


Advanced  Degree 


Some  Graduate  School 


Bachelor's  Degree 


Some  College 


High  School 


Figure  3.  Subject  Demographics:  Education  (Easterly,  1994) 

One  of  the  subjects  was  working  as  a  high  school  intern  and  had  not  completed  high  school  at  the  time  of 
this  experiment;  therefore,  only  29  subjects  appear  in  Figure  3. 
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Figure  4.  Subject  Demographics:  Gender  (Easteriy,  1994) 


Figure  5.  Subject  Demograpbics:  Grade/Rank  (Easterly,  1994) 


Treatment  Selection 

Two  sections  from  two  different  EISs  were  used  for  the  experiment.  One  of  the  EISs  was  entitled  Draft 
Environmental  Impact  Statement  —  Delaware  River  Comprehensive  Navigation  Study  and  was  prepared 
by  the  U.S.  Am^  Corps  of  Engineers  (USA  COE,  1990).  The  other  EIS  was  entitled  Final  Environmental 
Impact  Statement  —  Disposal  and  Reuse  of  Bergstrom  Air  Force  Base,  Texas  and  was  prepared  by  the 
Department  of  the  Air  Force  (DAF,  1993).  For  purposes  of  this  study,  we’ll  refer  to  these  EISs  as  the 
Delaware  River  Project  (DRP)  EIS  and  the  Bergstrom  AFB  (BAFB)  EIS. 
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The  two  sections  that  were  evaluated  in  each  EIS  were  the  Purpose  and  Needs  (P&N)  section,  which 
“briefly  describes  the  need  or  requirement  to  which  this  action  is  responding”,  and  the  Environmental  Ef¬ 
fects  (EE)  section,  which  “fonns  the  scientific  and  analytic  basis  for  the  comparison  of  alternatives”  (Jain 
and  others,  1993). 

The  discourse  ftlftments  manipulated  in  the  sample  EISs  were  linguistic  (qntax  and  tense)  and  nan- 
linguistic  (^'pogr^hy  and  white  space).  In  each  text  sample,  these  discourse  elements,  or  cues,  were 
mndififtit  so  that  cohesion  was  either  present  (+)  or  absent  (-).  With  four  separate  discourse  elemem  factor 
levels  (i^tax,  tense,  typography,  and  white  space)  and  two  factor  levels  for  the  state  of  cohesion  (+/-),  the 
Product  Rule  of  statistical  counting  techniques  declares  a  total  of  16  possible  factor  combinations  (Devore, 
1991:  52).  Each  of  these  potential  fiictor  combinations  is  a  ‘treatment’.  Easterly  enq)l(^ed  only  eight  of 
the  16  possible  treatments,  as  shown  in  Table  4. 


Table  4 

Experimental  Design  Treatments  (Easterly,  1994) 


The  following  eight  treatment  combinations  were  evaluated: 
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All  cohesive  discourse  elements  are  present,  except  white  space . Version  A 

All  cohesive  discourse  elements  are  present,  except  typography . Version  B 

All  cohesive  discourse  elements  are  present,  except  tense . Version  C 

All  cohesive  discourse  elements  are  present,  except  syntax . Version  D 

Only  linguistic  cohesive  discourse  elements  are  present . Version  E 

Only  non-linguistic  (visual)  cohesive  discourse  elements  are  present . Version  F 

All  cohesive  discourse  elements  are  present . Version  G 

No  cohesive  discourse  elements  are  present . Version  H 


It  is  aggitnpH  Easterly  chose  these  particular  treatments  so  she  could  most  efficiently  compare  the  efifects 
of  discourse  element  cohesion  on  the  subjects’  responses.  In  her  thesis.  Easterly  stated,  “[tjhe  original  in¬ 
tent  was  to  control  for  learning  effects  and  to  limit  the  amount  of  required  subject  participation  time” 
(1994: 42).  She  did  not  evaluate  treatments  in  which  only  one  of  each  of  the  two  cue  categories  (visual  or 
linguistic)  were  cohesive,  or  in  which  only  one  of  the  four  discourse  elements  were  cohesive  (typography, 
white  space,  tense,  or  syntax).  Instead,  she  chose  to  evaluate  three  basic  groups  of  treatments:  (1)  the 
‘one-out’  grotq),  (2)  the  ‘visual-linguistic’  groiq),  and  (3)  the  ‘all-or-nothing’  group. 

In  the  ‘one-out’  group,  only  one  of  the  discourse  elements  (typography,  white  space,  tense,  or  syntax)  was 
rendered  non-cohesive  in  the  experimental  EISs.  In  the  ‘visual-linguistic’  group,  both  of  the  discourse 
elements  in  one  of  the  cue  categories  (visual  or  linguistic)  were  rendered  non-cohesive,  while  the  dis¬ 
course  elements  in  the  other  cue  category  were  left  cohesive.  In  the  all-or-nothing  group,  the  discourse 
elements  rmder  study  were  either  all  cohesive  or  all  non-cohesive.  Specific  modifications  to  the  saitq)le 
EISs  are  further  explained  in  the  next  section. 

Treatment  Design 

The  following  sub-sections  describe  how  discourse  elements  of  the  EIS  sample  sectiorjs  were  modified  to 
create  or  inhibit  cohesive  structure.  Examples  from  sample  sections  are  provided  for  illustration.  Only  the 
basic  treatments  are  addressed  (-  ^pography,  -white  space,  -tense,  -qmtax).  Versions  firom  the  ‘visual- 
linguistic’  group  and  the  ‘all-or-nothing’  group  were  obtained  by  combining  effects  of  the  basic  treat¬ 
ments. 

White  Space 

Examples  extracted  from  Version  G  (-t-  all)  and  Version  A  (-  white  space)  of  the  EE  Section  of  the  DRP 
EIS  appear  on  the  following  pages  and  illustrate  the  cohesive  and  non-cohesive  use  of  white  space. 
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Cohesive  White  Space  (DRP  EE,  Version  G,  +011): 


ENVIRONMENTAL  EFFECTS 
Effects  of  Dredging  on  the  Delaware  River  and  Bay 

The  tentatively  selected  plan  of  improvement  consists  of  deepening  the  inbound  and  outbound 
lanes  of  the  Delaware  River,  Philadelphia  to  the  Sea  navigation  channel . . . 


Groundwater.  Dredging  activities  have  the  potential  to  adversely  impact  groundwater 
s^^pplies  Dredging  may  increase  the  hydraulic  connection  between  river . . . 


A  study  in  which  data  were  collected  on  the  lateral  and  vertical  distribution  of  sediments 
within  the  Delaware  River  navigation  channel  between  northeast  Philadelphia, . . . 


Hydrology.  The  major  hydrological  concern  with  respect  to  the  proposed  modification 
of  the  Delaware  River,  Philadelphia  to  the  sea  navigation  channel . . . 


In  order  to  evaluate  the  potential  salinity  impacts  associated  vtith  modifying  the  river  channel, 
a  study  was  conducted  by  the  Delaware  River  Basin . . . _ (Easterly,  1994) 


The  text  at  the  beginning  of  the  document  appears  to  be  a  title  due  to  the  white  space  on  either  side  of  the 
text,  in  addition  to  the  typographical  cues.  The  indentations  at  the  beginning  of  the  sections  entitled 
Groundwater  and  Hydrology  are  consistent  and  signal  to  the  reader  the  presence  of  a  new  section.  Ample 
space  between  paragraphs  provides  a  place  for  the  eyes  to  rest  as  well  as  separating  the  paragraphs.  Taken 
together,  these  different  uses  of  white  space  create  cohesion  in  the  document.  In  addition  to  the  white 
space  provided  by  Easterly,  extra  white  space  has  been  included  to  the  left  of  the  entire  block  of  text  to 
inrtiratft  that,  in  this  thesis,  it  is  an  extended  quote  from  another  author.  The  lines  surrounding  the  block 
of  text  also  serve  to  highlight  and  separate  the  quote  from  the  rest  of  the  thesis. 

The  following  exanq)le  text  is  inconsistent  and  confusing  in  its  use  of  white  space.  A  lack  of  space  follow¬ 
ing  the  second  heading,  “Effects  of  Dredging . . .”  feils  to  separate  the  heading  from  the  text.  There  is  no 
extra  line  before  the  subheading  Groundwater,  while  there  is  one  for  the  following  subheading  Hydrology. 
Also,  the  booty  of  text  immediately  follows  the  subheading  Groundwater,  while  there  is  a  blank  line  be¬ 
tween  the  subheading  Hydrology  and  the  following  text.  White  space  between  paragrrqths  varies  from 
nonexistent  to  a  foil  blank  line.  These  fectors  result  in  a  document  lacking  cohesive  white  space  cueing. 
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Non-cohesive  White  Space  (DRP  EE,  Version  A,  -  white  space): 

ENVIRONMENTAL  EFFECTS 
Effects  of  Dredging  on  the  Delaware  River  and  Bay 

The  tentatively  selected  plan  of  improvement  consists  of  deepening  the  inbound  and  outbound 
lanes  of  the  Delaware  River,  Philadelphia  to  the  Sea  navigation  channel . . . 


Groundwater.  Dredging  activities  have  the  potential  to  adversely  impact  groundwater 
supplies.  Dredging  m^  inaease  the  Itydranlic  connection  between . . . 


A  stud^  in  which  data  were  collected  on  the  lateral  and  vertical  distribution  of  sediments 
within  the  Delaware  River  navigation  channel  between  northeast  Philadelphia, ... 


Data  for  the  stn^  were  collected  using  the  geophysical  techniques  of  seismic  reflec¬ 
tion  and  electromagnetic  conductivity,  as  well  as  by  using  available  borehole . . . 


Hydrology 

The  major  hydrological  concern  with  respect  to  the  proposed  modification  of  the  Delaware 
River,  Philadelphia  to  the  sea  navigation  chaimel  is  the  potential . . . 


In  order  to  evaluate  the  potential  salinity  impacts  associated  with  modifying  the  river  channel, 
a  stvKfy  was  conducted  by  the  Delaware  River  Basin. . . _ (Easterly,  1994) 


Typography 

This  research  focused  only  on  heading  typography  as  cohesive  visual  cues,  rather  than  all  the  typography 
in  the  document.  Examples  extracted  from  Version  G  (+  all)  and  Version  B  (-  typography)  of  the  P&N 
Section  of  the  BAFB  EIS  illustrate  the  cohesive  and  non-cohesive  use  of  heading  typography. 

Cohesive  Heading  Typography  (BAFB  P&N,  Version  G,  +all): 

PURPOSE  AND  NEED 

Bergstrom  Air  Force  Base,  Texas,  was  one  of  the  bases  recommended  for  closure . . . 

Alternatives 

For  the  purpose  of  evaluating  potential  environmental  impacts  resulting  from . . . 

Summary  of  Environmental  Impacts  of  Proposed  Action 
Local  Community 

The  proposed  Action  would  result  in  increases  on  employment  and  population . . . 

Hazardous  Materials  and  Hazardous  Waste  Management 

The  types  of  hazardous  materials  and  waste  used  and  generated  as  a  result  of . . . 

Natural  Environment 

A  total  of  1,815  acres  would  be  disturbed  with  the  Proposed  Action -  (Easterly,  1994) 

In  this  example  of  cohesive  typographic  cues,  the  first  level  of  heading  hierarchy  used  an  all-capital,  bold, 
12-point,  Times  New  Roman  font,  which  was  centered  on  the  page.  The  second  level  of  heading  hierarchy 
used  the  same  formatting  options  as  the  first  level,  with  the  exception  of  the  capital  letters.  The  third  level 
of  heading  hierarchy  used  the  same  formatting  options  as  the  second  level,  but  the  alignment  was  left- 
justified.  Heading  alignment  pertains  more  to  the  use  of  white  space,  which  wifi  be  covered  in  the  next 
section. 


The  following  example  shows  how  mixing  up  the  heading  typography  can  lead  to  confusion  with  respect 
to  organization  and  reduce  overall  document  cohesion.  Although  the  first  level  of  heading  hierarchy  is 
formatted  the  same  as  the  previous  example,  the  second  level  headings  mix  up  the  use  of  underlines  and 
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italics,  The  third  level  headings  confound  the  use  of  bolding,  underlining,  and  alignment  to  reduce  cohe¬ 
sion. 

Non-cohesive  Heading  Typography  (BAFBP&N,  Version  B,  -  typography): 

PURPOSE  AND  NEED 

Bergstrom  Air  Force  Base,  Texas,  was  one  of  the  bases  recommended  for  closure . . . 

Alternatives 

For  the  purpose  of  evaluating  potential  environmental  impacts  resulting  from . . . 

Summary  of Environmental  Impacts  of Proposed  Action 
Local  Conununity 

The  proposed  Action  would  result  in  increases  on  employment  and  population . . . 

HazardoiLs  Materials  and  Hazardous  Waste  Management 
The  types  of  hazardous  materials  and  waste  used  and  generated  as  a  result  of . . . 

Natural  Environment 

A  total  of  1,815  acres  would  be  disturbed  with  the  Proposed  Action -  (Easterly,  1994) 
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Tense 


Consistent  use  of  tense  within  a  document  provides  cohesion.  Conversely,  mixing  up  past  and  present 
tensft  within  a  Hnnimfint  contributes  to  a  lade  of  cohesioii.  Examples  extracted  from  Version  G  (+  all)  and 
Version  C  (-  tense)  of  the  EE  Section  of  the  BAFB  EIS  illustrate  the  cohesive  and  non-cohesive  use  of 
tense. 


Cohesive  Tense  (BAFB  EE,  Version  G,  +  alty: 


Surface  Water.  With  the  Proposed  Action,  soils  would  be  contracted  during  new  con¬ 
struction  and  overlain  by  asphalt,  concrete,  or  buildings,  creating  impervious  surfaces  that 
would  result  in  increased  stormwater  runoff  to  stormwater  drainage  i^ems.  Drainage  patterns 
rfinlrt  be  altered  to  divmt  water  aws^  from  facilities  and  airfield  pavements,  including  the  new 
9000-foot  runway.  Stormwater  discharge  (nonpoint  source)  from  the  airfield,  aviation  siqqmrt, 
and  industrial  areas  may  contain  fuels,  oils,  and  other  residues  that  could  degrade  sur&ce  water 
resources,  particularly  Onion  Credc.  In  addition,  nonpoint  source  runoff  could  cause  high 
sediment  loads  in  the  drainage  systems. 

The  ammint  of  available  surface  water  would  not  change  with  the  Proposed  Action  because  no 
surfece  water  would  be  used  for  domestic,  industrial,  or  recreational  purposes.  Currently,  water 
is  supplied  by  the  City  of  Austin  from  surface  water  sources  off  the  base.  The  projected  increase 
in  water  use  with  the  Proposed  Action  would  be  within  the  capadly  of  the  dly’s  water  siqrply 
system.  _ [underlines  added]  (Easterly,  1994) 


The  tense  used  in  the  second  paragraph  matches  the  tense  used  in  the  first  paragraph  and  this  contributes 
to  document  cohesion.  In  both  the  non-cohesive  version  and  the  cohesive  versions,  the  first  paragraphs  are 
identical  :  however,  tense  in  the  second  paragraph  of  the  non-cohesive  version  does  not  match  that  of  the 
first  paragraph; 


Non-cohesive  Tense  (BAFB  EE,  Version  C,  -  tense): 


The  amniint  of  available  surface  water  will  not  change  with  the  Proposed  Action  because  no 
sur&ce  water  will  be  used  for  domestic,  industrial,  or  recreational  purposes.  Currently,  water  is 
supplied  by  the  City  of  Austin  from  surface  water  sources  off  the  base.  The  projected  increase 
in  water  use  with  the  Proposed  Action  wUl  be  within  the  capacity  of  the  city’s  water  supply 
system.  [underlines  added]  (Easterly,  1994) 
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Syntax 

Rq)eated  and  similar  ^tactic  forms  serve  as  cohesive  cues  within  a  document.  By  changing  the  syntactic 
form,  therdjy  producing  nonparallel  structure,  cohesion  within  sample  documents  was  reduced.  Examples 
extracted  from  Version  G  (+  all)  and  Version  D  (-  igmtax)  of  the  P&N  Section  of  the  DRP  EIS  illustrate 
the  cohesive  and  non-cohesive  use  of  syntax: 

Cohesive  Syntax  (DRP  P&N,  Version  G,  +  all): 


Plans  Eliminated  frmn  Future  Study 


Main  Channel  Deepening  -  Delaware  River,  Philadelphia  to  the  Sea  (50  foot  alterna¬ 
tive).  Tnitial  mnsidftratinns  of  deenening  the  existing  Delaware  River  navigation  channel  from 
Philadelphia  to  the  sea  included  alternative  depths  of  42, 45  and  50  feet  below . . . 

Main  Channel  Deepening  -  Delaware  River,  Philadelphia  to  Trenton.  Initial  consid¬ 
erations  of  deepening  the  existing  Delaware  River  navigation  channel  included  the  option . . . 


No  Action.  Tnirial  mnsideration.*;  also  included  the  possibility  of  no  action  or  modifications  to 
the  Delaware  River  navigation  channel. . . . _ [underlines  added]  (Easterly,  1994) 

Each  of  the  alternatives  listed  in  the  ‘Plans  Eliminated  from  Future  Study’  section  were  structured  in 
cimitar  syntactic  format,  resulting  in  cohesive  syntactic  cues.  The  non-cohesive  version  of  the  passage 
mixed  up  the  ^tactic  format,  resulting  in  a  lack  of  cohesion  cues. 

Non-cohesive  Syntax  (DRP  P&N,  Version  D,  -  syntax): 


Plans  Eliminated  from  Future  Study 


Main  Channel  Deepening  -  Delaware  River,  Philadelphia  to  the  Sea  (50  foot  alterna¬ 
tive).  Tnitial  considerations  of  deepening  the  existing  Delaware  River  navigation  channel  from 
Philadelphia  to  the  sea  included  alternative  depths  of 42, 45  and  50  feet  below . . . 

Main  Channel  Deepening  -  Delaware  River,  Philadelphia  to  Trenton.  A  study  was 
conducted  to  determine  the  feasibility  of  deepening  the  existing  Delaware  River . . . 


No  Action.  The  no  action  plan  would  entail  continued  maintenance  of  the  currently  authorized 
Delaware  River,  Philadelphia  to  the  sea.  Federal  navigation  chaimel. . . .  (Easterly,  1994) 
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Subject-Treatment  Assignment 

The  32  nriginal  subjects  were  randomly  assigned  to  one  of  eight  different  subject  groups,  resulting  in  a 
total  of  4  members  per  group.  Members  of  each  group  reviewed  fom  sample  EIS  sections  (BAFB  EE, 
BAFB  P&N,  DRP  EE,  and  DRP  P&N).  Table  5  describes  how  the  eight  treatments  (Version  A  through 
Version  H)  were  assigned  to  the  eight  groups  (Group  1  through  Group  8); 


Tables 

Assignment  of  EIS  Versions  to  Subject  Groups  (Easterly,  1994) 


Delaware  River  Project  EIS 

Bergstrom  Air  Force  Base  EIS 

Subject  Group  |  P&N  Section 

EE  Section 

P&N  Section 

EE  Section 

1 

Version  A 
(-  white  space) 

Version  B 
(-  typography) 

VersionC 

(-tense) 

Version  D 
(-igntax) 

2 

Version  B 
(-^graphy) 

VersionC 

(-tense) 

Version  D 
(-  syntax) 

Version  E 
(-all  visual) 

3 

Version  C 
(-  tense) 

Version  D 
(-^tax) 

Version  E 
(-all  visual) 

Version  F 
(-  all  linguistic) 

4 

Version  D 
(-  ^tax) 

Version  E 
(-all  visual) 

Version  F 
(-  all  linguistic) 

Version  G 
(+all) 

5 

Version  E 
(-all  visual) 

Version  F 
(-  all  linguistic) 

Version  G 
(+all) 

Version  H 
(-all) 

6 

Version  F 
(-  all  linguistic) 

Version  G 
(+all) 

Version  H 
(-all) 

Version  A 
(-  white  space) 

7 

Version  G 
(+all) 

Version  H 
(-all) 

Version  A 
(-  white  space) 

Version  B 
(-  ^graphy) 

8 

Version  H 
(-all) 

Version  A 
(-whitespace) 

Version  B 
(-typography) 

Version  C 
(-  tense) 

An  interpretation  of  Table  5  reveals  that  airy^  particular  subject  saw  only  four  of  the  eight  treatment  levels, 
or  versions.  For  example,  members  of  Groiq)  6  reviewed; 

•  Version  F  of  the  DRP  P&N  Section  (which  lacked  cohesive  linguistic  cues), 

•  Version  G  of  the  DRP  EE  Section  (which  emplr^ed  all  cohesive  cues), 

•  Version  H  of  the  BAFB  P&N  Section  (which  lacked  all  cohesive  cues),  and 

•  Version  A  of  the  BAFB  EE  Section  (which  lacked  cohesive  white  space  cues). 
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A  dififerent  inteipretation  of  Table  5  shows  that  EIS  Version  A  (-  white  ^ce)  was  reviewed  by  members 
of  Group  1,  Group  6,  Group  7,  and  Group  8.  Since  there  were  four  subjects  in  each  group,  a  total  of  16 
subjects  saw  Version  A.  The  same  is  true  for  eadi  version;  16  different  subjects  reviewed  each  treatment 


Test  Instrument 

In  her  research  effort.  Easterly  evaluated  only  the  objective  data  gathered  -  short-answer  response  accu¬ 
racy  and  efficiency.  Although  she  collected  subjective  data  at  the  time  of  her  experiment,  it  was  beyond 
the  scope  of  her  research  to  analyze  that  data.  It  is  the  purpose  of  this  research  to  assess  toe  subjective 
data. 

The  test  instrmtiRnt  used  for  collecting  subjective  data  was  a  series  of  statements  to  which  the  sulqects  re¬ 
sponded  on  a  Likert  scale  after  reviewing  each  EIS  section  and  completing  toe  short-answer  portion  of  toe 
experiment.  The  subjects  filled  in  circles  on  a  Scantron  machine-readable  answer  sheet  to  correspond  with 
toe  statements  on  toe  surveys  shown  in  Appendix  A. 

The  first  four  surveys,  one  for  each  document  reviewed,  were  composed  of  sixteen  items  related  to  the 
subjects’  perceptions  of  toe  document.  The  purpose  of  the  sixteen  items  was  to  gather  subjects’  opinions  of 
the  document’s  usability  and  coherence,  as  well  as  their  perceptions  of  toe  Gricean  toctors  of  quality, 
manner,  relation,  and  quantity. 

After  completing  toe  fourth  survqr,  the  subjects  were  given  a  final  survey  in  which  toq^  ranked  their  pref¬ 
erences  in  terms  of: 

•  one  section  over  another  (P&N  vs.  EE)  for  each  EIS, 

•  one  EIS  over  another  (DRP  vs.  BAFB)  for  each  section,  and 

•  one  combination  over  another  (BAFB  EE  vs.  BAFB  P&N  vs.  DRP  EE  vs.  DRP  P&N). 

Also,  this  survQ^  contained  four  demographic  statements,  toe  results  of  which  were  shown  in  Figure  2 
through  Figure  5.  As  before,  the  subjects  filled  in  circles  on  a  Scantron  machine-readable  answer  sheet 
corresponding  with  items  on  the  survey. 

The  stat<^ent  items,  and  toe  factors  thqr  were  intended  to  measure,  are  shown  in  Table  6  on  toe  follow¬ 
ing  page. 
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Table  6 

Survey  Items  (Easterly,  1994) 


Question 

Number 

Measured 

Factor 

Variable 

Name 

Item 

1, 17, 33, 49 

Usability 

USEOl 

I  easily  answered  the  questions  I  was  given  Ity  using  this 
section  of  the  EIS. 

2,  18,  34,  50 

Coherence 

COH02 

The  author  made  this  section  of  the  EIS  understandable. 

3, 19, 35,  51 

Coherence 

COH03 

i  understocxl  this  section  of  the  EIS. 

4, 20, 36,  52  1  Relation 

REL04 

I  could  see  the  relationships  between  all  the  pieces  of  in¬ 
formation  in  this  section  of  the  EIS. 

5,21,37,53  ilisai^ly  j 

USE05 

The  author  made  this  section  of  the  EIS  eaty  to  use  in  an¬ 
swering  the  questions  I  was  given. 

6, 22, 38,  54  j  Manner 

MAN06 

The  purpose  of  this  section  of  the  EIS  was  clear. 

■•iiiitftw 

The  author  made  this  section  of  the  EIS  conqilete. 

KVJit  JgHHII 

This  section  of  the  EIS  was  accurate. 

9, 25, 41,  57  j  Relation 

REL09 

The  author  made  it  easy  to  see  the  relationships  between  all 
the  pieces  of  information  in  this  section  of  the  EIS. 

10, 26, 42,  58  1  Quantity 

This  section  of  the  EIS  gave  too  much  information. 

11, 27, 43, 59  1  Relation 

RELll 

The  author  made  sure  ^  of  the  information  in  this  section 
of  the  EIS  was  clearly  related. 

12,  28, 44, 60 
.....  ..  .. 

Maimer 

MAN12  i  The  meaning  ofthis  section  ofthe  EIS  was  clear.  | 

Quantity 

QTY13 

This  section  of  the  EIS  gave  too  little  information. 

14,30,46r« 

QLT14 

The  auAor  made  this  section  of  the  EIS  accurate. 

15,  31,  47, 63  I  (Quality 

QLT15 

The  information  in  this  section  of  the  EIS  was  well  sup¬ 
ported. 

16,  32,  48, 64  |  Manner 

MAN16 

The  au&or  made  this  section  of  the  EIS  clear. 

65  1  Preference 

P65 

I  preferred  one  section  of  the  EIS  concerning  the  Delaware 
River  Project  over  the  other. 

66  j  Preference 

P66 

i  prrferr^  one  section  of  the  EIS  concerning  the  Bergstrom 
AFB  Closing  over  the  other. 

67  1  Preference 

P67 

i  prefer!^  one  Purpose  &  Need  section  over  the  one  from 
the  other  EIS. 

68  1  Preference 

P68 

I  preferred  one  Environmental  Effects  section  over  the  one 
from  the  other  EIS. 

69  1  Preference 

P69 

.1  preferred  one  of  the  four  EIS  sections  I  read  today  over 
any  of  the  others. 

70  i  Demographic 

D70 

j  Your  age  is:  (list  of  selections  given) 

71  I  Demographic 

D71 

1  Your  highest  educational  level  obtained  is:  (list  of  selections 
given) 

71  1  Demographic 

D72 

Your  gender  is:  (list  of  selections  given) 

73  1  Demographic 

D73 

You  are:  (list  of  selections  given) 

The  tenn  questions  mentioned  in  statement  items  such  as,  “I  easily  answered  the  questions  I  was  given  by 
ncing  this  section  of  the  EIS,”  referred  to  the  short-answer  questions  from  the  objective  portion  of  the 
study. 
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'uantilVing  Response  Choices 


Subjects  responded  to  statement  items  1-69  using  a  five-step  Likert  scale  which  allowed  them  to  order 
their  responses  along  a  measurement  continuum; 


Strongly - Disagree - Neither  Agree - Agree - Strongly 

Disagree  Nor  Disagree  Agree 

ABC  D _ E 


For  example,  if  subjects  strongly  agreed  with  statemem  item  3,  “I  understood  this  section  of  the  EIS,”  they 
would  fill  in  the  circle  marked  “E”. 

To  makfi  mathematical  analysis  of  the  responses  possible,  numbers  were  assigned  to  each  choice,  thus 
trangfftrming  the  data  firom  qualitative  ordinal  level  data  to  quantitative  interval  level  data.  These  numbers 
are  referred  to  as  ‘scores’  or  ‘ratings’.  The  range  of  agreement  choice  was  bipolar  because  it  varied  from 
total  agreement  to  total  disagreement  (Spector,  1992: 22).  Hie  scores  were  assigned  so  th^  ranged  firom  - 
2  (A:  Strongly  Disagree)  to  2  (E:  Strongly  Agree)  to  reflect  this  bipolar  arrangement.  The  neutral  response 
(C:  Neither  Agree  nor  Disagree)  was  assigned  a  score  of  zero.  This  symmetric  arrangement  of  values 
around  a  neutral  middle  ground  reflects  an  intuitive  mapping  of  the  subjects’  opinions  to  a  numerical 
scale: 


Strongly - - Disagree - Neither  Agree - Agree - Strongly 

Disagree  Nor  Disagree  Agree 

-2 _ _ 0 _ 1 _ 2 

Provided  they  were  ‘similar’  enough,  the  ratings  for  several  different  statement  items  could  be  combined, 
or  ‘summated’,  to  provide  a  more  sensitive  measurement.  The  concept  of  summated  rating  scales  are  de¬ 
scribed  in  the  following  sectioa 

Summated  Rating  Scales 

The  surveys  used  for  measuring  the  subjects’  opinions  used  Likert-style  rating  scales  intended  to  measure 
their  perceptions  of  usability,  coherence,  quality,  manner,  relation,  and  quantity.  When  possible,  the  rat¬ 
ings  on  the  individual  questions  were  combined  to  form  summated  rating  scales.  Summated  rating  scales 
are  Hifffirftnt  fi'om  standard  scales  in  that  they  use  several  different  statements,  or  ‘items’,  to  measure  one 
concept,  or  ‘construct’. 
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Four  characteristics  make  a  scale  a  sununated  rating  scale:  (1)  the  scale  must  contain  multiple  items 
which  are  combined  to  form  a  construct;  (2)  each  individual  item  must  measure  something  that  has  an 
underfying,  quantitative  measurement  continuum;  (3)  each  item  has  no  ‘right’  answer,  and  (4)  each  item 
in  a  scale  is  a  statement,  and  respondents  are  asked  to  give  ratings  about  each  statement  (Spector,  1992: 
1).  The  statemftnt  items  on  the  test  instrument  met  these  criteria,  and  the  six  constructs  measured  by  the 
various  items  were  usability,  coherence,  quality,  manner,  relation,  and  quantity. 

Spector  (1992: 2)  gives  three  reasons  why  the  sununated  rating  scale  format  is  often  used.  First,  it  can 
produce  scales  that  have  good  reliability  and  validity.  Second,  a  summated  rating  scale  is  relatively  cheap 
and  easy  to  develop.  Third,  a  well-developed  scale  is  usually  quick  and  ea^  for  respondents  to  complete. 
The  issues  of  reliability  and  validity  are  addressed  in  the  following  sub-sections. 

ReUability  Versus  Validity 

Reliability  and  validity  are  terms  used  to  describe  the  ‘goodness’  of  a  test  instrument.  “Reliability  assures 
that  a  scale  can  consistently  measure  something,”  while  validity  assures  that  a  scale  “will  measure  what  it 
is  designed  to  measure”  (Spector,  1992: 6-7).  To  illustrate  this  point,  consider  a  tape  measure:  it  is  a  very 
reliable  instrument  for  measuring  linear  distances;  however,  it  may  not  be  valid  for  measuring  time.  An 
instrument  such  as  a  stopwatch,  on  the  other  hand,  would  be  both  reliable  and  valid  for  measuring  time. 

Reliability 

Reliability  can  be  examined  in  two  different  dimensions,  test-retest  reliability  and  internal  consistency 
reliability  (Spector,  1992).  Test-retest  reliability  refers  to  the  likelihood  that  a  test  instrument  would  pro¬ 
vide  the  same  results  if  the  test  is  repeated  a  number  of  times.  Since  this  was  a  one-time,  one-of-a-kind 
experiment,  test-retest  reliability  is  not  an  issue. 

“Internal  consistency  reliability  means  that  multiple  items,  designed  to  measure  the  same  construct,  will 
intereorrelate  with  one  another”  (Spector,  1992: 6).  The  test  instrument  will  be  evaluated  for  internal 
consistency  reliability  using  the  coefficient  alpha  (Ca)  statistic.  Since  it  is  a  drrect  function  of  both  the 
number  of  items  in  a  construct  as  well  as  the  magnitude  of  the  scale  used,  Ca  is  a  measure  of  the  internal 
consistency,  thus  reliability,  of  a  scale  (Spector,  1992:  31).  The  formula  for  Ca  is  shown  in  Figure  6,  be¬ 
low.  Immediately  following  the  figure  is  Specter’s  e^lanation  of  how  the  coefficient  should  be  inter¬ 
preted: 
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k  sj,-2^sj 

a= - X - ^ — ,  where 

k-l  Sf 

jy  =  the  total  variance  of  the  sum  of  items, 
sj  =  the  variance  of  an  individual  item, 

_ k  =  the  number  of  items  in  the  construct. _ 

Figure  6.  Coefficient  Alpha  (Spector,  1992: 32) 

The  values  of  coefficient  alpha  lo(^  like  correlation  coefficients,  but  alpha  is  not  a  correlation.  It 
is  usually  positive,  faking  on  values  from  0  to  just  under  1.0,  where  larger  values  indicate  higher 
levels  of  internal  consistency. ...  [A]  widely  accepted  rule  of  thumb  is  that  alpha  should  be  at 
least  0.70  for  a  scale  to  demonstrate  internal  consistenQr.  Nhmy  scales  friil  to  achieve  this  level, 
making  their  use  questionable  at  best  It  is  possible  to  find  a  negative  coefficient  alpha  if  items 
correlate  negatively  with  one  another.  This  occurs  if  items  are  not  properly  reverse  scored.  As¬ 
suming  all  items  have  been  scored  in  the  proper  direction,  alpha  should  be  positive.  (Spector, 
1992:  32) 

The  ‘reverse  scoring’  Spector  mentions  refers  to  the  w^  in  which  individual  items  in  a  construct  are 
worded.  For  exanqfle,  if  the  construct  of  interest  were  whether  or  not  people  like  to  watch  sports  on  tele¬ 
vision,  an  item  statement  could  be  worded,  “I  like  watching  sports  on  TV,”  and  responses  could  range 
from  (A)  strongly  agree  to  (E)  strongly  disagree.  Conversely,  the  statement  could  be  worded,  “I  dislike 
watching  sports  on  TV.”  A  subject  who  responded  ‘strongly  agree’  to  the  first  statement  would  logically 
respond  ‘strongly  disagree’  to  the  second  statement.  Since  double-negatives  can  be  confusing  (“I  disagree 
that  I  dislike  rwitching  sports  on  TV”),  they  are  usually  avoided;  however,  if  negative  Cas  are  encoun¬ 
tered,  reverse  scoring  may  be  one  way  to  bring  the  ratings  into  aligmnent. 

Validity 

While  reliability  can  be  measured  with  relative  ease,  validity  caimot.  As  Spector  points  out,  ‘The  most 

difficult  part  of  scale  development  is  validation  -  that  is,  interpreting  what  the  scale  scores  represent - 

Part  of  the  difficulty  is  that  validation  can  only  occur  within  a  system  of  hypothesized  relations  between 
the  construct  of  interest  and  other  constracts”  (1992:  46).  This  research  erqrlores  the  relationships  between 
the  constructs  measuring  usability,  coherence,  quality,  manner,  relation,  and  quantity. 

As  with  reliability,  validity  can  be  measured  on  two  different  dimensions:  criterion-related  validity  and 
discriminant  validity  (Spector,  1992: 47).  One  sub-type  of  criterion-related  validity  is  concurrent  validity. 
Again  quoting  Spector: 
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Concuirent  validity  can  be  tested  Ity  simultaneously  collecting  data  from  a  sample  of  respondents 
on  the  scale  of  interest  and  on  criteria,  hypothesize  to  relate  to  the  scale  of  interest.  Concurrent 
in  the  context  refers  to  the  simultaneous  collection  of  all  data.  B^theses  are  typically  that  the 
scale  of  interest  will  conelate  with  one  or  more  criteria.  The  finding  that  there  are  statistically 
signifirjint  relations  of  the  scale  with  hypothesized  variables  is  taken  as  support  for  validity. 
(1992: 48) 


Simultaneous  collection  of  data  fiom  a  sample  of  subjects  was  the  technique  used  in  this  study;  therefore, 
concurrent  validity  will  be  verified  through  anal}^  of  the  results.  If  it  is  found  that  the  constructs  of  in¬ 
terest  are  highly  correlated  with  the  criteria  named  in  the  Itypotheses,  then  it  will  be  assumed  the  meas¬ 
urement  is  valid. 


Data  Analysis 

The  data  fiom  the  Scantron  machine-readable  answer  sheets  were  transcribed  into  a  Microsoft  Excel 
spreadsheet  for  formatting,  manipulation-  and  analysis.  Additionally,  the  data  were  copied  into  files  which 
could  be  used  by  SAS  and  Statistix  statistical  analysis  software.  The  Excel  spreadsheet  is  shown  in  Ap¬ 
pendix  B,  the  AIS  files  in  Appendix  C,  and  the  Statistix  files  in  Appendix  D. 

Two  of  the  subjects.  Number  19  and  Number  25,  did  not  correctly  fill  out  the  Scantron  answer  sheet, 
hence,  their  data  was  not  included  in  the  analysis.  Fortunately,  these  subjects  were  in  different  groups 
(Group  3  and  Group  1,  respectively)  and  the  absence  of  their  data  should  not  significantly  affect  the  re¬ 
sults. 

Analysis  Strategy 

The  following  steps  were  taken  to  analyze  the  data: 

1 .  Determine  which  constructs  are  eligible  for  summation  {reliability). 

2.  Determine  which  constructs  are  correlated  {validity). 

3 .  Determine  if  there  is  a  statistically  significant  difference  in  construct  responses  with  respect  to 
treatments. 

4.  Determine  if  there  is  a  statistically  significant  difference  in  the  subjects’  preference  of  one  section 
over  another  with  respect  to  treatments. 
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The  concepts  of  reliability  and  validity  have  alreacfy  been  addressed.  Reliability  will  be  assessed  through 
evaluation  of  Ca,  which  is  described  above.  Validity  will  be  assessed  through  evaluation  of  Spearman 
Coefficients  of  Rank  Correlation  (SCRC).  The  SCRC  technique  was  selected  for  data  analysis  because 
matrhpd  pairs  of  measurements  were  compared  (Gibbons,  1976: 274).  Using  this  method,  for  example, 
subjects’  responses  to  usability  questions  can  be  conqrared  with  their  responses  to  coherence  questions.  If 
usability  and  coherence  are  highly  positively  correlated,  it  would  be  ejqwcted  that  the  subjects’  responses 
to  these  questions  would  be  consistently  similar.  On  the  other  hand,  if  usability  and  coherence  are  highly 
negatively  correlated,  it  would  be  expected  that  the  subject’s  responses  would  be  consistently  dissimilar. 
Finally,  if  usability  and  coherence  are  not  correlated,  it  would  be  expected  that  the  subject’s  responses 
would  be  neither  consistently  similar,  nor  consistentty  dissimilar.  A  thorough  description  of  the  formula¬ 
tion  of  the  SCRC  can  be  found  in  Gibbons  (1976:  275-278). 

In  order  to  assess  the  statistical  significance  of  subjects’  responses  and  preferences  with  respect  to  treat¬ 
ments,  it  will  be  necessary  to  discuss  the  statistical  tool  of  Analysis  of  Variance  (ANOVA). 

Statistical  Significance  of  Means 

Statistical  significance  of  the  data  was  assessed  through  single-factor  ANOVA  and  the  Tukey  method  of 
means  comparison.  The  following  sub-sections  describe  the  ANOVA  and  Tukey  procedures. 

ANOVA 

Because  ANOVA  specifically  relies  on  the  F-^stribution,  several  conditions  had  to  be  met  prior  to  assess¬ 
ing  the  data.  First,  it  had  to  be  assumed  that  the  population  was  normally  distributed.  Second,  the  obser¬ 
vations  had  to  be  independent.  Third,  the  observations  had  to  have  approximately  equal  variances,  that  is, 
they  had  to  be  homoscedastic. 

Normal  distribution  of  the  samples  was  initially  assessed  tty  plotting  and  examining  histograms  of  the 
data,  sorted  by  construct  These  histograms  were  graphed  by  Statistix  and  are  shown  in  Appendix  D, 
Figure  17  through  Figure  26,  on  pages  144  through  148.  Distribution  normality  was  not  readily  apparent 
by  examination  of  the  histograms;  therefore,  further  analysis  was  performed  through  the  Wilk- 
Shapiro/Rankit  procedure  in  Statistix.  For  purposes  of  this  research,  a  minimum  Wilk-Shapiro  value  of 
0.80  and  a  relatively  linear  appearance  of  the  plotted  data  points  were  assumed  adequate  for  declaration  of 
normality.  The  Wilk-Shapiro/Rankit  plots  are  shown  in  Appendix  D,  Figure  37  through  Figure  46,  on 
pages  154  through  158.  A  summary  of  the  Wilk-Shapiro  values  is  shown  in  Table  7. 
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Table  7 

Wilk-Shapiro  Normality  Assessment  Snmmary 


Construct/Preference 

Approximate  WUkShfqnro  Value 

Coherence 

0.9527 

Manner 

0.9302 

Quality 

0.8813 

Relation 

0.9531 

Usability 

0.9360 

P65 

0.8801 

P66 

0.9202 

P67 

0.8581 

P68 

0.8753 

P69 

0.8115 

Since  the  Wilk-Shapiro  value  was  greater  than  0.80  for  each  construct,  it  was  assumed  the  data  were  nor¬ 
mally  distributed. 

Independence  of  observations  was  obtained  through  the  design  of  the  experiment  itself.  The  responses  of 
one  subject  should  in  no  way  have  influenced  the  responses  of  any  of  the  other  subjects  because  the  test 
instruments  were  administered  individually  and  communication  between  subjects  was  prohibited.  There¬ 
fore,  inter-subject  independence  can  safely  be  assumed.  Furthermore,  since  each  of  the  subjects  read  four 
different  EIS  sections  which  had  been  altered  by  foin  different  treatments,  intra-subject  independence  was 
assumed,  albeit  not  as  strongly  as  inter-subject  independence.  There  exists  a  possibility  that  some  learning 
and  practice  effects  could  have  taken  place  between  readings,  especially  as  the  subjects  read  two  sections 
from  the  same  EIS,  such  as  the  EE  and  P&N  sections  of  the  DRP  EIS. 

Finally,  homoscedasticily  was  verified  by  Statistix  through  Bartlett’s  Test  of  Equal  Variances  as  it  per¬ 
formed  the  ANOVA.  The  reader  is  referred  to  the  Statistix  output  on  page  159  of  Appendix  D.  A  sum¬ 
mary  of  the  homoscedasticity  measures  is  shown  in  Table  8. 


42 


Table  8 


Homoscedasticity  Summary 


BarUett^s  P-Value 

Cochranes  Q 

harshest  Var/ Smallest  Var 

Coherence 

0.9772 

0.1631 

1.6220 

Manner 

0.9679 

0.1690 

1.7635 

Quality 

0.7906 

0.1814 

2.2727 

Relation 

0.8675 

0.1694 

1.8811 

Usability 

0.9809 

0.1668 

1.6871 

P65 

0.9669 

0.1695 

1.8633 

P66 

0.9999 

0.1417 

1.2383 

P67 

0.9232 

0.1571 

1.9545 

P68 

0.9886 

0.1481 

1.6091 

P69 

0.9996 

0.1422 

1.3213 

The  relatively  high  P-valnes  from  Bartlett’s  test  indicated  a  strong  probability  that  the  variances  were  ap¬ 
proximately  equal.  Even  though  the  Bartlett  Test  value  of 0.7906  for  the  quality  construct  appears  low 
compared  to  the  other  constructs,  is  does  not  suggest  that  the  variances  are  not  equal  (Statistix  Manual: 
131).  Another  value  Statistix  provides  is  Cochran’s  Q,  which  is  the  ratio  of  the  largest  within-group  vari¬ 
ance  over  the  sum  of  all  within-group  variances.  The  relatively  small  values  in  the  last  column  of  Table  8 
also  siqtport  the  existence  of  homoscedasticity,  thus  making  ANOVA  a  viable  tool  for  analysis. 


Tuk^ 

The  final  statistical  tool  employed  was  the  Tukey  Method  of  Multiple  Comparisons.  In  this  study,  the 
Tukey  method  was  used  to  compare  the  mean  value  of  scores  from  each  summated  construct  and  prefer¬ 
ence,  while  maintaining  an  experimentwise  error  rate  (a)  of  0.05.  A  detailed  explanation  of  the  Tukey 
Method  can  be  found  in  Devore  (1991:  381),  Keppel  (1991:  173),  and  Neter  and  others  (1990:  580).  The 
Statistix  manual  also  contains  a  brief  description  of  the  method  (1994: 214). 


Summary 

This  chapter  began  by  describing  the  overall  experiment  design  and  giving  a  demographic  outline  of  the 
32  subjects.  Next,  it  explained  how  the  various  discourse  elements  were  manipulated  in  the  eight  sample 
EIS  sections  and  how  the  subjects  were  randomly  assigned  to  eight  different  groups.  The  test  instrument 
itself;  a  series  of  statements  requiring  Likert-scale  responses  firom  the  subjects,  was  then  described.  To 
explain  how  scores  from  different  statements  in  the  test  instrument  could  be  combined  into  constructs,  the 
reader  was  introduced  to  the  concept  of  summated  rating  scales  and  how  they  are  analyzed  for  reliability 
and  validity.  Finally  the  strategy  Ity  which  the  experimental  data  was  to  be  analyzed  was  presented  to  the 
reader,  along  with  justification  for  assumptions  made  by  the  researcher.  The  following  chapter  describes 
the  results  of  data  analysis  in  order  of  strate©^  employed. 
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V.  Results  and  Discussion 


Determine  \Miich  Constructs  Are  Eligible  For  Summstion 

The  first  step  in  the  analysis  strategy  was  to  determine  if  the  items  contained  within  the  six  constructs 
could  be  summated,  that  is,  determine  if  the  constructs  demonstrated  internal  consistency  reliability.  Ca 
for  each  construct  was  conqnited  by  SAS,  as  shown  in  Appendix  C.  Graphical  representations  of  the  re¬ 
sults  ate  also  shown  in  /^HJendix  C;  however,  the  graphs  for  the  coherence  construct  and  the  quantity 
construct  merit  special  attention  and  are  shown  in  Figure  7  and  Figure  8: 
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Figure  7.  Coefficient  Alpha  for  COHERENCE  Construct 


Figure  7  shows  the  value  of  Ca  for  the  coherence  construct  with  respect  to  each  version  of  the  EIS.  Addi¬ 
tionally,  an  overall  Ca  is  shown  for  all  treatments  combined.  The  coherence  construct  was  composed  of 
two  different  item  statements:  COH02  and  COH03.  This  graph  shows  that  it  was  possible  to  sum  ratings 
for  items  COH02  and  COH03  into  a  single  construct  for  all  treatments,  with  the  exception  of  Version  B  (- 
typography)  and  Version  C  (-  tense).  Since  the  Ca  for  Versions  B  and  C  are  less  than  the  cutoff  value  of 
0.70  (Spector,  1994:  32),  they  could  not  be  summated. 

The  values  of  Ca  for  the  manner  construct  were  greater  than  0.70  for  each  treatment;  therefore,  the  indi¬ 
vidual  ratings  for  items  MAN06,  MAN12,  and  MAN16  could  be  summated,  irrespective  of  version. 
Likewise,  the  values  of  Ca  for  the  quality  construct  were  greater  than  0.70  for  each  treatment;  therefore, 
the  individual  ratings  for  items  QLT08,  QLT14,  and  QLT15  could  be  summated,  irrespective  of  version. 
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Figure  8.  Coefficient  Alpha  for  QUANTITY  Construct 

The  left  side  of  Figure  8  shows  the  values  of  Ca  for  the  quantity  (QTY)  construct  with  respect  to  each 
version  of  the  EIS.  The  negative  values  of  the  QTY  construct  indicated  the  probability  that  some  item 
statements  m^  required  reverse  scoring  (Spector,  1992;  32).  In  an  attempt  to  resolve  the  problem,  ratings 
for  item  QTY13  were  multiplied  by  negative  one  (-1)  and  labeled  QTY13R.  A  new  construct,  QTYR,  was 
created  consisting  of  items  QTYIO  and  QTY13R.  The  right  side  of  the  graph  shows  the  values  of  Ca  for 
the  newly  created  QTYR  construct  Even  with  reverse  scoring,  the  values  of  Ca  were  less  than  0.70  in  all 
cases;  therefinre,  the  quantity  construct  was  not  summated  nor  further  evaluated. 

The  values  of  Ca  for  the  relation  construct  were  greater  than  0.70  for  each  treatment;  therefore,  the  indi¬ 
vidual  ratings  for  items  REL04,  REL09,  and  RELl  1  could  be  summated,  irrespective  of  version.  Simi¬ 
larly,  the  values  of  Ca  for  the  usability  construct  were  greater  than  0.70  for  each  treatment;  therefore,  the 
individual  ratings  for  items  USEOl  and  USE05  could  be  summated,  irrespective  of  versioa 

Finally  the  values  of  Ca  for  the  combination  of  all  constructs  were  greater  than  0.70  for  each  treatment; 
therefore,  the  individual  ratings  for  all  items  could,  theoretically,  be  summated,  irrespective  of  version. 
Essentially,  this  means  all  items  in  the  test  instrument  were  measuring  the  same  all-encompassing  ‘meta¬ 
construct’.  Ostensibly,  this  meta-construct  could  be  document  ‘goodness’;  however,  it  is  beyond  the  scope 
of  this  thesis  to  fiirther  ejqjlore  this  idea. 


The  findings  of  the  Ca  analysis  are  summarized  in  Table  9: 
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Table  9 


Summary  of  Codncient  Alpha  Analysis 


Construct  j 

EIS  Version 

A 

B 

c 

D 

E 

F 

G 

H 

ALL 

Coherence  I 

X 

. 

- 

X 

X 

X 

X 

X 

X 

Manner 

X 

X 

X 

X 

X 

X 

X 

X 

X 

X 

X 

X 

X 

X 

X 

X 

X 

X 

- 

- 

- 

- 

- 

- 

- 

- 

- 

Relation 

X 

X 

X 

X 

X 

X 

X 

X 

X 

Usability 

X 

X 

X 

X 

X 

X 

X 

X 

X 

Overall 

X 

X 

X 

X 

X 

X 

X 

X 

X 

Kev 

X 

Coefficient  Alpha  S:  0.70;  therefore,  summation  is  possible. 

- 

Coefficient  Alpha  <  0.70;  therefore,  summation  is  not  possible. 

These  results  indicate  that,  for  most  of  the  constructs,  internal  consistency  reliability  was  obtained.  The 
coherence  construct  and  the  quality  construct  were  notable  exceptions. 

The  coherence  construct  was  internally  consistent  for  most  EIS  versions;  however,  the  reason  wlty  internal 
consistency  reliability  was  not  achieved  for  Version  B  (-  typography)  and  Version  C  (-  tense)  remains  un¬ 
explained.  No  basis  within  cohesion  theory  could  be  found  to  account  for  this  anomaly.  Therefore,  the  co¬ 
herence  construct  will  not  be  used  for  further  analysis  within  Versions  B  and  C.  It  will,  however,  be  in¬ 
cluded  for  analysis  of  Versions  A,  D,  E,  F,  G,  and  H. 

The  quality  construct  was  a  different  matter  entirely.  Due  to  the  w^  in  which  the  item  statements  were 
worded,  it  proved  impossible  to  combine  subjects’  responses  into  one  scale.  One  question  measured  ade¬ 
quacy  —  “The  author  made,  this  section  of  the  EIS  complete”  —  while  the  other  two  questions  in  the  con¬ 
struct  measured  extremes  —  “TTiis  section  of  the  EIS  gave  too  much  (too  little)  information.”  Even  reverse 
scoring  one  of  the  ‘extreme’  questions  and  dropping  the  ‘adequacy’  question  failed  to  rectify  the  problem; 
therefore,  the  quality  construct  was  eliminated  from  further  analysis. 

Determine  Which  Constructs  Are  Correlated 

The  second  step  in  analysis  was  to  determine  which  of  the  summated  constructs  could  be  correlated,  and 
thus  attempt  to  address  concurrent  validity  of  the  test  instrument. 

The  Spearman  Coefficient  of  Rank  Correlation  for  each  construct  was  computed  by  Statistix,  as  shown  in 
Appendix  D.  A  value  of  0.80  was  used  as  the  minimum  acceptable  value  for  a  ‘strong  positive’  correlation 
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(Devore,  1991: 205).  Likewise,  a  correlatioii  value  between  0.5  and  0.8  was  considered  ‘moderate’  and  a 
value  below  0.5  was  considered  ‘weak’.  Table  10  summarizes  the  results  obtained  by  Statistix. 


Table  10 


Summary  Spearman  Rank  Coefficients  of  Correlation 


SCRC  values  varied,  depending  upon  the  treatment  being  investigated.  For  example,  the  relation  construct 
was  strongly  correlated  with  the  manner  construct  except  in  Version  G  -  the  version  in  which  all  dis¬ 
course  elements  were  cohesive.  On  the  other  hand,  the  quality  construct  was  strongly  correlated  with  the 
manner  construct  only  in  Version  B  ~  the  version  in  which  typographic  discourse  elements  were  non- 
cohesive. 

In  general.  Table  10  shows  the  coherence,  manner,  relation,  and  usability  constructs  to  be  well  correlated 
with  each  other,  with  the  exception  of  Version  D  (-tyntax),  in  which  only  maimer  and  relation  are 
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strongly  correlated.  Table  10  also  shows  the  quality  construct  to  be  only  moderately  or  weakly  correlated 
with  the  rest  of  the  constructs,  with  the  excq)tion  of  Version  B  (-  typography),  in  which  the  quality  con¬ 
struct  is  strongly  correlated  with  the  manner  and  relation  constructs.  The  ‘strength’  of  a  construct’s  corre¬ 
lation  with  the  other  constructs  can  be  seen  in  Figure  9,  which  is  an  illustration  of  the  number  of  ‘strong’, 
‘moderate’,  and  ‘weak’  SCRC  values  from  Table  10. 


Figure  9.  SCRC  Iirtcr-correlation  Graph 


Figure  9  shows  the  general  strength  of  intercorrelation  between  the  individual  constructs.  Note  that  the 
manner,  relation,  coherence,  and  usability  constructs  have  a  signiQcant  number  of  ‘strong’  and  ‘moderate’ 
correlations,  while  the  quality  has  relatively  few.  A  reminder  to  the  reader;  the  coherence  construct  col¬ 
umn  is  shorter  than  the  rest  because  the  coherence  construct  could  not  be  summated  for  Version  B  (-  ty¬ 
pography)  and  Version  C  (-  tense)  because  of  a  lack  of  internal  consistency  reliability. 

In  the  Methodology  chapter,  it  was  stated  that  if  it  was  found  the  constructs  of  interest  are  highly  corre¬ 
lated  with  the  criteria  named  in  the  hypotheses,  then  it  could  be  assumed  the  measurement  is  valid.  Due  to 
the  relatively  low  number  of  strong  or  moderate  correlations  between  the  quality  construct  and  aity  of  the 
other  constructs,  it  will  not  be  assumed  that  the  quality  dimension  of  the  measurement  is  vahd. 

Determine  Statistical  Significance  Of  Construct  Responses 

The  third  step  in  analysis  was  to  determine  if  there  was  a  statistically  significant  difference  in  the  way  the 
subjects  responded  to  the  surv^  statements  based  on  the  version  they  reviewed.  A  one-way  ANOVA  was 
performed  on  the  summated  ratings  for  each  construct.  After  the  ANOVA  was  completed,  a  Tukey  multi- 
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pie  comparisons  procedure  was  performed  in  order  to  determine  if  there  were  significant  pairwise  differ¬ 
ences  between  the  means.  A  value  of  0.05  was  assumed  for  the  ejq)erimentwise  error  rate  (Devore,  1991; 
384).  The  results  are  shown  in  Table  11: 


Table  11 

TukQT  Pairwise  Comparisons  of  Means  by  Version  (  Constructs) 


Construct 

Ver 

Mean 

Homogenous 

Groups 

Construct 

Ver 

Mean 

Homogenous 

Groups 

Coherence 

G 

1.0625 

I 

Relation 

G 

1.2500 

I 

Coherence 

B 

1.0000 

I 

Relation 

A 

0.6667 

I 

Coherence 

A 

1.0000 

I 

Relation 

D 

0.6429 

I 

Coherence 

C 

0.9286 

I 

Relation 

H 

0.4375 

I 

Coherence 

H 

0.8750 

I 

Relation 

B 

0.3333 

I 

Coherence 

D 

0.8571 

I 

Relation 

F 

0.3333 

I 

Coherence 

F 

0.6000 

I 

Relation 

C 

0.2857 

I 

Coherence 

E 

0.5333 

I 

Relation 

E 

-0.4000 

I 

Manner 

G 

1.5000 

I 

Usability 

A 

0.7333 

I 

Manner 

B 

1.0667 

I 

Usability 

B 

0.7333 

I 

Manner 

A 

1.0000 

I 

Usability 

G 

0.6875 

I 

Manner 

C 

0.9286 

I 

Usability 

D 

0.5000 

I 

Manner 

F 

0.7333 

I 

Usability 

C 

0.4286 

I 

Manner 

D 

0.5714 

I 

Usability 

H 

0.3750 

I 

Manner 

H 

0.5625 

I 

Usability 

F 

0.3333 

I 

Manner 

E 

0.2667 

I 

Usability 

E 

0.2667 

I 

A 

1.1333 

I 

F 

0.8000 

I 

Quality 

G 

0.6875 

I 

Quality 

E 

0.6000 

I 

Quality 

D 

0.5000 

I 

Quality 

B 

0.4667 

I 

Quality 

H 

0.4375 

I 

Quality 

C 

0.2857 

I 

There  are  no  significant pairmse  dijferences  among  the  means. 


In  every  construct  examined,  there  were  no  significant  pairwise  differences  between  the  means  of  the 
summated  ratings  for  the  different  versions. 

Determine  Statistical  Significance  Of  Subjects’  Section  Preferences 

The  fourth  and  final  step  in  analysis  was  to  determine  if  there  was  a  statistically  significant  difference  in 
the  subjects’  preferences  of  one  section  over  another.  As  before,  a  one-way  ANOVA  was  accomplished  on 
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the  subjects’  responses  to  survey  items  65  through  69.  After  the  ANOVA  was  completed,  a  Tukey  proce 
duie  was  performed  with  an  experimentwise  error  rate  of  0.05.  The  results  are  shown  in  Table  12: 


Table  12 

Tukey  Pairwise  Comparisons  of  Means  by  Version  (Subject  Preferences) 


Question 

Comparing... 

Within 

VER 

Mean 

Homogenous 

Groups 

P65 

Sections 

DRPEIS 

G 

0.5000 

I 

P65 

Sections 

DRPEIS 

E 

0.3750 

I 

P65 

Sections 

DRPEIS 

D 

0.2857 

I 

P65 

Sections 

DRPEIS 

F 

0.2500 

I 

P65 

Sections 

DRPEIS 

H 

0.1250 

I 

P65 

Sections 

DRPEIS 

C 

-0.4286 

I 

P65 

Sections 

DRPEIS 

A 

-0.7143 

I 

P65 

Sections 

DRPEIS 

B 

-0.8571 

I 

P66 

Sections 

BAFBEIS 

F 

0.8571 

I 

P66 

Sections 

BAFBEIS 

E 

6.7143 

I 

P66 

Sections 

BAFBEIS 

G 

0.3750 

I 

P66 

Sections 

BAFBEIS 

D 

0.2857 

I 

P66 

Sections 

BAFBEIS 

H 

-0.1250 

I 

P66 

Sections 

BAFBEIS 

C 

-0.1429 

I 

P66 

Sections 

BAFBEIS 

A 

-0.2500 

I 

P66 

Sections 

BAFBEIS 

B 

-0.2500 

I 

P67 

EISs 

P&N  Section 

F 

0.6250 

I 

P67 

EISs 

P&N  Section 

E 

0.4286 

I 

P67 

EISs 

P&N  Section 

D 

0.3750 

I 

P67 

EISs 

P&N  Section 

H 

0.2500 

I 

P67 

EISs 

P&N  Section 

C 

0.1667 

I 

P67 

EISs 

P&N  Section 

G 

0.1250 

I 

P67 

EISs 

P&N  Section 

B 

0.0000 

I 

P67 

EISs 

P&N  Section 

A 

-0.1429 

I 

EE  Section 
EE  Section 
EE  Section 
EE  Section 
EE  Section 
EE  Section 
EE  Section 
EE  Section 


0.8750 

0.8333 

0.7143 

0.6250 

0.5714 

0.5000 

0.5000 

0.2500 


There  are  no  asnifiemt  pairmse  differences  among  the  means. 


Again,  for  every  preference  question  examined  there  were  no  significant  pairwise  differences  between  the 
mpans  of  the  subjects’  response  with  respect  to  the  versions  read.  Stated  otherwise,  there  was  no  statisti¬ 
cally  signifirant  difference  in  the  subjects’  preferences  of  one  section  over  another  within  a  particular  EIS, 
of  one  EIS  over  another  within  a  particular  section,  or  <rf  ary  particular  ElS/section  combination  over  any 
other  combination,  irrespective  of  version.  More  succinctfy,  the  subjects  had  no  preferences  between  the 
documents  they  read,  regardless  of  whether  or  not  any  of  the  discourse  elements  in  the  doounent  were  co¬ 
hesive. 
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VI.  Conclusions  and  Recommendations 

This  chapter  has  three  objectives.  First,  it  will  draw  conclusions  about  the  results  of  data  analysis  in  terms 
of  the  hypotheses.  Second,  it  will  attempt  to  explain  why  the  results  appear  to  be  unsqjported  by  the  the¬ 
ory  behind  the  hypotheses.  Third,  it  will  outline  recommendations  for  further  research. 

Conclusions  With  Respect  to  the  Hypotheses 

Hypothesis  #1:  Coherent  documents  are  cohesive. 

On  page  1  of  Chapter  1,  the  reader  was  introduced  to  this  hypothesis  which  was  posed  as  a  question: 

Are  coherence  measurements,  such  as  subjects’  Likert  scale  responses  to  statements  regarding  coherence, 
relation,  manner,  quality,  and  quantity,  related  to  the  presence  or  absence  of  cohesive  discourse  ele¬ 
ments,  such  as  typography,  white  space,  tense,  and  syntax? 

This  question  was  divided  into  smaller  sub-questions  which  were  then  assessed  through  experimentation. 
These  sub-questions,  and  the  conclusions  that  were  drawn  as  a  result  of  the  experiment,  are  shown  below: 

a.  Are  perceptions  of  coherence  (comprehensibility  or  readability  of  a  discourse)  related  to  the  pres¬ 
ence  or  absence  of  cohesive  discourse  elements? 

No.  There  was  no  statistical  significance  between  the  subject’s  preferences  or  responses  to  the  coher¬ 
ence  questions  with  respect  to  the  different  EIS  versions  reviewed.  The  reader  is  referred  to  the 
ANOVA  results  beginning  on  page  159  of  Appendix  D  and  to  the  Tukey  Pairwise  Comparison  of 
Means  summary  in  Table  1 1  on  page  49. 

b.  Are  perceptions  of  relation  (relevance  or  relatedness  of  information)  related  to  the  presence  or  ab¬ 
sence  of  cohesive  discourse  elements? 

No.  There  was  no  statistical  significance  between  the  subject’s  preferences  or  responses  to  the  rela¬ 
tion  questions  with  respect  to  the  different  EIS  versions  reviewed.  Again,  the  reader  is  referred  to  the 
ANOVA  results  beginning  on  page  159  of  Appendix  D  and  to  the  Tukey  Pairwise  Comparison  of 
Means  summary  in  Table  11  on  page  49. 

c.  Are  perceptions  of  manner  (clarity  of  information)  related  to  the  presence  or  absence  of  cohesive 
discourse  elements? 
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No.  There  was  no  statistieal  significanee  between  the  subject’s  preferences  or  responses  to  the  man¬ 
ner  questions  with  respect  to  the  different  EIS  versions  reviewed.  Again,  the  reader  is  referred  to  the 
ANOVA  results  beginning  on  page  159  of  Appendix  D  and  to  the  Tukey  Pairwise  Comparison  of 
Means  summary  in  Table  1 1  on  page  49. 

d.  Are  perceptions  of  quality  (truth  or  accuracy  of  the  information)  related  to  the  presence  or  absence 
of  cohesive  discourse  elements? 

No.  There  was  no  statistical  significance  between  the  subject’s  preferences  or  responses  to  the  quality 
questions  with  respect  to  the  different  EIS  versions  reviewed.  Again,  the  reader  is  referred  to  the 
ANOVA  results  beginning  on  page  159  of  Appendix  D  and  to  the  Tukey  Pairwise  Comparison  of 
Means  summary  in  Table  1 1  on  page  49. 

e.  Are  perceptions  of  quantity  (amount  of  information)  related  to  the  presence  or  absence  of  cohesive 
discourse  elements? 

As  noted  in  on  page  45  in  Chapter  5,  it  was  not  possible  to  summate  the  quality  construct;  therefore, 
no  fiirther  analysis  was  performed. 

f.  Are  perceptions  of  coherence  correlated  mtk  perceptions  of  relation,  manner,  quality,  and  quantity? 

Mostly.  The  amount  of  correlation  between  these  constructs  was  relatively  strong  in  most  cases;  how¬ 
ever,  the  strength  of  correlation  between  the  quality  construct  and  the  other  constructs  was  less  sig¬ 
nificant.  The  reader  is  referred  to  Table  10  on  page  47,  and  Figure  9  on  page  48. 

The  first  hypothesis  in  this  thesis  can,  therefore,  not  be  accepted  as  true  based  upon  the  experimental  evi¬ 
dence.  There  is  no  statistically  significant  difference  between  subjects’  Likert  scale  responses  to  state¬ 
ments  regarding  the  experimental  constracts  of  coherence,  manner,  quality,  and  relation,  with  respect  to 
the  eight  different  EIS  versions  tested. 

The  second  hypothesis  can  now  be  considered. 

Hypothesis  #2;  Usable  documents  are  cohesive. 

Like  the  first  hypothesis,  the  second  hypothesis  was  posed  as  a  question: 
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Are  usability  measurements,  such  as  subjects  ’  Likert  scale  responses  to  statements  regarding  usability, 
related  to  the  presence  or  absence  of  cohesive  discourse  elements,  such  as  typography,  white  space, 
tense,  and  syntax? 

This  question  was  divided  into  two  sub-questions  which  were  then  assessed  through  experimentation. 
These  sub-questions,  and  the  conclusions  that  were  drawn  as  a  result  of  the  experiment,  are  shown  below: 

a.  Are  perceptions  of  usability  (ease  of  comprehending  or  withdrawing  information  from  the  discourse) 
related  to  the  presence  or  absence  of  cohesive  discourse  elements? 

No.  There  was  no  statistical  significance  between  the  subject’s  preferences  or  responses  to  the  us¬ 
ability  questions  with  respect  to  the  different  EIS  versions  reviewed.  The  reader  is  referred  to  the 
ANOVA  results  beginning  on  page  159  of  Appendix  D  and  to  the  Tukey  Pairwise  Comparison  of 
Means  summary  in  Table  11  on  page  49. 

b.  Are  perceptions  of  usability  correlated  with  perceptions  of  coherence? 

Yes.  The  reader  is  referred  to  Table  10  on  page  47.  usability  and  coherence  were  strongly  correlated 
for  Versions  A,  E,  F,  and  G;  and  moderately  correlated  with  Version  D.  Summation  and  analysis  of 
the  coherence  construct  for  Versions  B  and  C  were  not  possible  due  to  low  Coefficient  Alpha  scores, 
as  shown  in  Figure  7  on  page  44. 

The  second  hypothesis  in  this  thesis  can,  therefore,  not  be  accepted  as  true  based  upon  the  experimental 
evidence.  There  is  no  statistically  significant  difference  between  subjects’  Likert  scale  responses  to  state¬ 
ments  regarding  the  experimental  construct  of  usability,  with  respect  to  the  eight  different  versions  tested. 

Discussion  of  Anomaious  Resuits 

In  spite  of  the  body  of  knowledge  preceding  this  research  which  would  predict  detectable  differences  in 
subjects’  perceptions  of  usability,  no  statistical  significance  could  be  observed  between  or  among  the  vari¬ 
ous  treatments  of  discourse  elements.  This  is  not  entirely  surprising,  however,  since  Easterly  obtained  the 
essentially  the  same  results  with  the  objective  data  from  this  experiment  (1994).  The  question  arises,  then, 
as  to  why  these  results  were  obtained.  Several  factors  present  themselves  as  possible  contributors,  includ¬ 
ing  subject  selection,  experiment  design,  and  complexity  of  underlying  theory. 
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Subject  Selection 

The  fact  that  most  subjects  had  at  least  a  bachelor’s  degree,  were  mature,  and  were  familiar  with  technical 
and  scientific  terms  could  have  influenced  their  perception  of  the  sample  EISs.  They  may  have  been  able 
to  ‘see  past’  the  structural  errors  and  judge  the  documents  coherent  in  spite  of  a  lack  of  cohesion  cues.  As 
Anderson  and  Davison  pointed  out,  ‘interestingness’  and  depth  of  the  reader’s  background  knowledge 
may  be  more  significant  contributors  to  readability  than  such  prosaic  indicators  as  sentence  length  and 
word  count  (1988).  Indeed,  cohesion  theory  emphasizes  that  both  cohesion  and  coherence  are  ptychologi- 
cal  phenomena  and  cohesion  is  only  partly  manifested  in  a  physical  fashion.  There  may  have  been 
enough  cohesive  cues  present  in  the  documents  [even  in  Version  H  (-  all)]  to  allow  the  well-educated  and 
interested  subjects  to  create  enough  implicature  for  the  documents  to  appear  coherent  to  them. 

Experiment  Design 
Sample  Size 

The  number  of  subjects  that  participated  in  the  experiment  may  have  been  inadequate  for  detecting  subtle 
Hifyomnccs  between  versions.  This  assertion  is  supported  by  the  extremely  low  values  for  Power  of  the  F- 
Test  that  were  obtained  in  Appendix  E.  Table  13  below  shows  a  summary  of  the  power  calculations. 


Table  13 

F-Test  Power  Calculation  Summary 


Construct/Preference 

Power  = 

Coherence 

0.3633 

P<0.50 

Usability 

0.3097 

P<0.50 

Manner 

0.4554 

P<0.50 

Relation 

0.5531 

P  <0.50 

Quality 

0.5242 

P  <0.50 

P65 

1.1122 

0.56 

P66 

0.9659 

P<0.50 

P67 

0.6435 

P  <0.50 

P68 

0.5777 

P  <0.50 

P69 

0.3257 

P  <0.50 

In  almost  every  case.  Table  13  indicates  there  is  less  than  a  0.50  probability  that  the  alternate  hypothesis 
(that  there  is  a  statistically  significant  diEFerence  in  the  ratings)  could  have  correctly  been  accepted. 
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Block  Design 

The  structure  of  the  experiment,  discussed  in  \be  Methodology  chapter,  may  have  influenced  the  results. 
Easterly  summarized  the  problem  in  the  conclusion  to  her  thesis: 


[T]he  impact  of  formulating  an  incomplete  subject  data  set  were  not  apparent.  It  appears,  how¬ 
ever,  (hat  this  oversi^t  nu^  have  confounded  our  results  by  not  giving  us  a  complete  data  set  to 
analyze.  As  we  have  noted  previously,  each  subject  only  received  4  of  8  possible  Versions.  In  or¬ 
der  to  properly  analyze  data  sets,  the  data  most  be  collected  in  a  specific  balanced  manner,  which 
varies  according  to  the  number  of  treatments.  In  the  case  of  this  stady,  the  data  was  not  collected 
in  the  balanced  manner  that  would  lend  itself  to  an  appropriate  application  of  statistics,  like 
ANOVA.  (Easterly,  1994: 42-43) 


Factor  Level  Selection 

The  amniint  of  difference  in  the  fiictor  levels  was  somewhat  qualitative  and  arbitrary.  How  much  were  the 
discourse  elements  ‘messed  up’  in  order  to  declare  them  non-cohesive?  Are  there  different  levels  of 
‘cohesiveness’?  For  example,  could  one  treatment  of  white  space  be  somewhat  non-cohesive,  while  an¬ 
other  treatment  of  white  space  be  extremely  non-cohesive? 

Test  Instrument  Design 

The  way  in  which  the  survq^  statements  were  written  had  some  effect;  particularly  the  statements  written 
for  the  quantity  construct  Since  it  was  impossible  to  summate  the  ratings  for  the  quantity  construct  it  was 
impossible  to  correlate  and  compare  the  amount  of  information  to  the  usability  of  the  document. 

Complexity  Of  Underlying  Theory 

As  Easterly  pointed  out  in  the  conclusion  of  her  thesis,  ‘The  underlying  theory  and  experimental  design 
made  this  research  very  difficult  to  conceive  and  to  plan.  Because  of  these  Actors,  this  effort  was  con¬ 
structed  as  a  pilot  stud|y,  to  test  out  hypotheses  while  makmg  observations  for  future  ejqrerimental  work” 
(1994: 41).  Since  this  was  indeed  a  pilot  stuc^,  several  recommendations  for  further  research  are  made  in 
the  following  section. 

Recommendations  For  Further  Research 
Subject  Selection 

The  subjects  used  for  this  experiment  were  obtained  out  of  convenience;  however,  a  more  appropriate  pool 
of  subjects  should  be  located  for  further  testing.  Researchers  should  strive  to  find  subjects  who  more 
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closely  represent  the  type  of  people  for  whom  the  CEQ  modeled  their  readability  requirements:  decision 
makers  and  lay  persons. 

Experiment  Desten 

One  way  to  increase  the  power  of  a  test  like  the  one  performed  in  this  stu^  would  be  to  increase  the 
sample  siie.  It  is  exceedingly  difficult,  given  the  data  obtained,  to  specifically  recommend  an  ^prqpriate 
sample  size;  however,  it  would  be  safe  to  assume  that  doubling  the  sample  size  would  increase  the  power 
of  the  test,  perhaps  within  acceptable  limits.  Also,  researchers  should  strive  to  apply  principles  of  good, 
balanced  experiment  design.  Several  sources  (Neter  and  others,  1990;  Keppel,  1991;  Devore,  1991)  de¬ 
scribe  good  design  practice  for  setting  up  randomized  block  experiments. 

Multivariate  ANOVA  (MANOVA)  and  factor  analysis  are  tools  that  could  be  applied  to  this  research  if 
the  dimension  of  cohesion  were  explored  more  fully.  For  example,  if  a  quantitative  method  for  creating 
the  different  factor  levels  could  be  incorporated  into  the  experimental  design,  it  may  be  possible  to  per¬ 
form  MANOVA  and  &ctor  analysis  to  assess  the  effect  of  cohesive  discourse  elements  on  another  dimen¬ 
sion:  amount  of  cohesion,  rather  than  simply  the  presence  or  absence  of  cohesive  cues. 

Test  Instrument 

One  of  the  positive  results  of  this  study  was  a  partial  validation  of  the  test  instrument.  The  statement  items 
for  the  quantity  construct  would  have  to  be  rewritten  in  order  for  the  construct  to  attain  internal  consis¬ 
tency  reliability,  however,  this  could  be  accomplished  by  using  an  evaluation  item,  rather  than  an  agree¬ 
ment  item  (Specter,  1992:  23).  Instead  of  addng  the  subject  for  a  level  of  agreement  with  a  statement  such 
as  “There  was  too  much  information  in  the  document”,  the  researcher  could  phrase  the  statement  “The 
amount  of  information  in  the  document  was...”  and  ask  the  subject  to  respond  on  a  continuum  fi'om 
“nonexistent”  to  “excessive”.  Spector  recommends  that  many  different  item  stems  be  prepared  and  a  pilot 
test  be  accomplished  in  order  to  ‘weed  out’  items  stems  which  do  not  reliably  achieve  their  purpose.  He 
provides  much  advice  on  the  construction  of  summated  rating  scales  in  his  1992  monogr^h,  and  recom¬ 
mends  several  other  sources  of  information. 
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Appendix  A:  Surveys 

fiMiftral  Dftsmprion:  Ttus  appendix  contains  copies  of  the  five  surveys  which  were  distributed  to  the  ex¬ 
periment  participants.  They  are  described  below  and  appear  in  their  entirety  on  succeeding  pages. 

Survey  1:  (Questions  1-16)  The  subjects  answered  the  questions  on  this  survey  after  they  had  read  the 
Purpose  and  Need  section  of  the  Delaware  River  Project  EIS.  Questions  1-16  are  identical  to 
questions  17-32, 33-48,  and  49-64. 

Survey  2:  (Questions  17-32)  The  subjects  answered  the  questions  on  this  survey  after  they  had  read  the 
Environmental  Effects  section  of  the  Delaware  River  Project  EIS.  (^estions  17-32  are  identical 
to  questions  1-16,  33-48,  and  49-64. 

Surv^3;  (Questions  33-48)  The  subjects  answered  the  questions  on  this  survey  after  they  had  read  the 
Purpose  and  Need  section  of  the  Bergstrom  Air  Force  Base  Closure  EIS.  (^estions  33-48  are 
identical  to  questions  1-16, 17-32,  and  49-64. 

Survey  4:  (Questions  49-64)  The  subjects  answered  the  questions  on  this  survey  after  they  had  read  the 
Environmental  Effects  section  of  the  Bergstrom  Air  Force  Base  Closure  EIS.  Questions  49-64 
are  identical  to  questions  1-16, 17-32,  and  33-48. 

Survey  5;  ((Questions  65-73)  After  completing  the  firurth  survey,  the  subjects  were  given  a  final  survey  in 
which  they  ranked  their  preferences  in  terms  of: 

•  one  section  over  another  (P&N  vs.  EE)  for  each  EIS, 

•  one  EIS  over  another  (DRP  vs.  BAFB)  for  each  section,  and 

•  one  combination  over  another  (BAFB  EE  vs.  BAFB  P&N  vs.  DRP  EE  vs.  DRP  P&N). 
Also,  this  survQ'  contains  four  demographic  statements. 
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Instructions:  Please  choose  one  of  the  five  possible  answers  for  each  of  the 
following  statements.  Record  your  answer  by  filling  in  the  appropriate  space 
on  the  machine-scored  response  sheets  provided.  (The  lettered  spaces  on  that 
sheet  correspond  to  the  responses  in  the  scale  below.) 

Work  at  a  steady,  rapid  pace.  Do  not  return  to  previous  responses. 


Strongly - 

- Disagree — 

— Neither  Agree - 

- Agree - Strongly 

Disagree 

Nor  Disagree 

Agree 

A 

B 

C 

D  E 

1. 

2. 

3. 

4. 

5. 

6. 

7. 

8. 

9. 

10. 
11. 
12. 

13. 

14. 

15. 

16. 


I  easily  answered  the  questions  I  was  given  by  using  this  section  of  the  EIS. 

The  author  made  this  section  of  die  EIS  understandable. 

I  imderstood  this  section  of  the  EIS  . 

I  could  see  the  relationships  between  all  the  pieces  of  information  in  this  section  of  the  EIS. 
The  author  made  this  section  of  the  EIS  easy  to  use  in  answering  the  questions  I  was  given. 
The  purpose  of  this  section  of  the  EIS  was  clear. 

The  author  made  this  section  of  the  EIS  conqilete. 

This  secti(Hi  of  tiie  EIS  was  accurate. 

The  author  made  it  easy  to  see  the  relationships  between  all  the  pieces  of  information  in 
this  section  of  the  EIS. 

This  section  of  the  EIS  gave  too  much  infonnation. 

The  author  madR  sure  all  of  the  information  in  this  section  of  the  EIS  was  clearly  related. 

The  mRaning  of  this  section  of  the  EIS  was  clear. 

This  section  of  the  EIS  gave  too  little  information. 

The  author  made  this  section  of  the  EIS  accurate. 

The  information  in  this  section  of  the  EIS  was 
well  supported. 

The  author  made  this  sectimi  of  the  EIS  clear. 


The  subjects  answered  the 
questions  on  this  survey  after 
they  had  read  the  Purpose  and 
Need  section  of  the  Delaware 
lUver  Project  EIS.  Questions  1- 
16  are  identical  to  questions  1 7- 
32,  33-48,  and  49-64. 
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Instructions:  Please  choose  one  of  the  five  possible  answers  for  each  of  the 
following  statements.  Record  your  answer  by  filling  in  the  appropriate  space 
on  the  machine-scored  response  sheets  provided.  (The  lettered  spaces  on  that 
sheet  correspond  to  the  responses  in  the  scale  below.) 

Work  at  a  steady,  rapid  pace.  Do  not  return  to  previous  responses. 


Strongly — - Disagree - Neither  Agree - Agree  - — < — -  Strongly 

Disagree  Nor  Disagree  Agree 

A  B  C  D  E 


17.  I  easily  answered  the  questions  I  was  given  by  using  this  section  of  the  EIS. 

18.  The  author  made  this  section  of  the  EIS  understandable. 

19.  I  understood  this  section  of  the  EIS  . 

20.  I  could  see  the  relationships  between  all  tiie  pieces  of  informaticHi  in  this  section  of  the  EIS. 

21.  The  author  made  this  section  of  the  EIS  easy  to  use  in  answering  the  qu^ons  I  was  given. 

22.  The  purpose  of  this  section  of  the  EIS  was  clear. 

23.  The  author  made  this  section  of  the  EIS  complete. 

24.  This  section  of  the  EIS  was  accurate. 

25.  Die  author  made  it  easy  to  see  the  relationships  between  all  the  pieces  of  information  in 
this  section  of  the  EIS. 

26.  This  section  of  the  EIS  gave  too  much  information. 

27.  The  author  made  sure  all  of  the  information  in  this  section  of  the  EIS  was  clearly  related. 

28.  The  meaning  of  this  section  of  the  EIS  was  clear. 

29.  This  section  of  the  EIS  gave  too  little  information. 

30.  The  author  made  this  section  of  the  EIS  accurate. 

3 1 .  The  information  in  this  section  of  the  EIS  was 
well  supported. 

32.  The  author  made  this  section  of  the  EIS  clear. 


The  subjects  answered  the 
questions  on  this  survey  after 
they  had  read  the  Environ¬ 
mental  Effects  section  of  the 
Delaware  Mver  Project  EIS. 
Questions  1 7-32  are  identical  to 
questions  1-16,  23-48,  and  49- 
64. 
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Instructions:  Please  choose  one  of  the  five  possible  answers  for  each  of  the 
following  statements.  Record  your  answer  by  filling  in  the  appropriate  space 
on  the  machine-scored  response  sheets  provided.  (The  lettered  spaces  on  that 
sheet  correspond  to  the  responses  in  the  scale  below.) 

Work  at  a  steady,  rapid  pace.  Do  not  return  to  previous  responses. 


Strong — 

•— — Disagree — 

— Neither  Agree — 

- Agree - 

- Strongly 

Disagree 

Nor  Disagree 

Agree 

A 

B 

C 

D 

£ 

33. 

34. 

35. 

36. 

37. 

38. 

39. 

40. 

41. 

42. 

43. 

44. 

45. 

46. 

47. 

48. 


I  easily  answered  the  questions  I  was  given  by  using  this  section  of  the  EIS . 

The  author  made  this  sectitm  of  the  EIS  understandable. 

I  imderstood  this  section  of  the  EIS  . 

I  could  see  the  relationships  between  all  the  pieces  of  information  in  this  section  of  die  EIS. 
The  author  made  this  section  of  the  EIS  easy  to  use  in  answering  the  questions  I  was  given. 
The  purpose  of  this  section  of  the  EIS  was  clear. 

The  author  made  this  section  of  the  EIS  complete. 

This  section  of  tiie  EIS  was  accurate. 

The  author  made  it  easy  to  see  the  relationships  betwera  all  the  pieces  of  information  in 
this  section  of  the  EIS. 


This  section  of  the  EIS  gave  too  much  informaticm. 

The  author  made  sure  all  of  the  information  in  tiiis  section  of  the  EIS  was  clearly  related. 


The  meaning  of  this  section  of  the  EIS  was  clear. 

This  section  of  the  EIS  gave  too  little  informa¬ 
tion. 

The  author  made  this  section  of  the  EIS  accu¬ 
rate. 

The  information  in  this  section  of  the  EIS  was 
well  supported. 

The  author  made  this  section  of  the  EIS  clear. 


The  subjects  answered  the 
questions  on  this  survey  after 
they  had  read  the  Purpose  and 
Need  section  of  the  Bergstrom 
Air  Force  Base  Closure  EIS. 
Questions  33-48  are  identical  to 
questions  1-16,  17-32,  and  49- 
64. 
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Instructions:  Please  choose  one  of  the  five  possible  answers  for  each  of  the 
following  statements.  Record  your  answer  by  filling  in  the  appropriate  space 
on  file  machine-scored  response  sheets  provided.  (The  lettered  spaces  on  that 
sheet  correspond  to  the  responses  in  the  scale  below.) 

Work  at  a  steady,  rapid  pace.  Do  not  return  to  previons  responses. 


Strong - 

- Disagree- 

- Neither  Agree - 

— Agree - Strongly 

Disagree 

Nor  Disagree 

Agree 

A 

B 

C 

D  E 

49. 

50. 

51. 

52. 

53. 

54. 

55. 

56. 

57. 

58. 

59. 

60. 
61. 

62. 

63. 

64. 


I  easily  answered  the  questions  I  was  given  by  using  this  section  of  the  EIS. 

The  author  made  this  section  of  the  EIS  understand^le. 

I  understood  tiiis  section  of  the  EIS  . 

I  could  see  the  relationships  between  all  tiie  pieces  of  information  in  this  section  of  the  EIS. 
The  author  made  this  section  of  the  EIS  easy  to  use  in  answering  the  questions  I  was  given. 
The  purpose  of  this  section  of  tiie  EIS  was  clear. 

The  author  made  this  section  of  the  EIS  complete. 

Ihis  section  of  the  EIS  was  accurate. 

The  a»itVinr  made  it  easy  to  see  the  relationships  betweai  all  the  pieces  of  information  in 
this  sectimi  of  the  EIS. 

This  section  of  tiie  EIS  gave  too  much  information. 

The  author  made  sure  ail  of  tiie  information  in  this  section  of  tiie  EIS  was  clearly  related. 

The  meaning  of  this  section  of  the  EIS  was  clear. 

This  section  of  the  EIS  gave  too  little  informa¬ 
tion. 

The  author  made  this  section  of  the  EIS  accurate. 

The  information  in  this  section  of  the  EIS  was 
well  supported. 

The  author  made  this  section  of  the  EIS  clear. 


The  subjects  answered  the 
questions  on  this  survey  after 
they  had  read  the  Environ¬ 
mental  Effects  section  of  the 
Bergstrom  Air  Force  Base  Clo¬ 
sure  EIS.  Questions  49-64  are 
identical  to  questions  1-16, 17- 
32,  and  33-48. 
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Instructions:  Please  answer  the  following  questions  by  marking  the  appro¬ 
priate  spaces  on  your  machine-scored  sheet. 


Strongly — - 

- - Disagree -~ 

— Neither  Agree - 

- Agree - 

—  Strongly 

Disagree 

Nor  Disagree 

Agree 

A 

B 

C 

D 

E 

65.  I  preferred  one  sectiaa  of  die  EIS  concerning  die  Delaware  River  project  over  the  other. 

66.  I  preferred  one  section  of  the  EIS  concerning  die  Bergstrcnn  AFB  closing  over  the  other. 

67.  I  preferred  <Mie  Purpose  &  Need  secdcm  over  the  (me  from  die  other  EIS. 

68.  I  prrferred  one  Environmental  Effects  section  over  the  xme  from  the  other  EIS. 

69.  I  preferred  one  of  the  four  EIS  sections  I  read  today  over  any  of  die  others. 

70.  Your  age  is 

a.  25  years  or  less 

b.  26  through  35  years 

c.  36  through  45  years 

d.  46  throu^  55  years 

e.  56  years  or  more 

7 1 .  Your  highest  educational  level  obtained  is 

a.  '  high  school  diploma  or  GED 

b.  some  college 

c.  Bachelor’s  degree 

d.  some  graduate  school 

e.  graduate  degree  (Master's  or  Ph.D.) 

72.  Your  gender  is 

a.  female 

b.  male 

73.  You  are 

a.  U.S.  military  officer 

b.  U.S.  oilisted 

c.  civilian  (GS  level  1 0  or  above) 

d.  civilian  (GS  level  1  throu^  9) 

e.  other 


THANK  YOU  FOR  YOUR  PARTICIPATION!! 


Appendix  B:  Excel  Database 

Onftrai  nftscription:  This  appendix  contains  a  compilation  Of  the  raw  data  collected  during  the  experi¬ 
ment  The  subject  nuniber  and  group  number  are  shown  on  each  page  in  order  to  give  the  reader  a  refer¬ 
ence.  The  pgfts  are  divided  into  the  six  constructs,  as  well  as  preference  and  demogn5)hic  questions.  A 
summary  of  the  responses  for  each  subject  is  shown  on  the  last  p3ge. 
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Coherence 


Subject 

Number 

Group 

Number 

Basic 

2 

C 

2 

2 

C 

18 

2 

C 

34 

2 

C 

50 

3 

C 

3 

3 

C 

19 

3 

C 

35 

3 

C 

51 

Construct 

Iton 

1 

1 

E 

B 

D 

D 

E 

B 

D 

D 

9 

1 

B 

C 

D 

D 

B 

D 

D 

D 

17 

1 

A 

B 

D 

D 

D 

D 

D 

D 

25 

1 

2 

2 

B 

D 

D 

D 

B 

D 

D 

D 

10 

2 

C 

C 

D 

D 

C 

B 

D 

D 

18 

2 

D 

B 

E 

D 

D 

D 

D 

D 

26 

2 

A 

B 

D 

A 

D 

A 

D 

B 

3 

3 

D 

D 

D 

B 

D 

D 

D 

D 

11 

3 

D 

B 

B 

D 

D 

B 

B 

D 

19 

3 

27 

3 

B 

B 

D 

D 

D 

B 

D 

D 

4 

4 

A 

B 

D 

C 

C 

D 

D 

D 

12 

4 

E 

D 

E 

E 

E 

D 

E 

E 

20 

4 

B 

C 

C 

B 

C 

D 

D 

B 

28 

4 

B 

B 

D 

D 

B 

B 

D 

D 

5 

5 

C 

B 
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Appendix  C:  SAS  Statistical  Analysis  Files 

fiftiiftrai  nesRription-  This  appendix  contains  the  S4S  programs  written  to  analyze  the  data,  as  well  as 
their  results.  It  is  divided  into  the  different  EIS  versions,  and  the  constructs  and  preferences  are  analyzed 
within  EIS  versions.  First,  the  S4S  program  (*.SAS  file)  for  that  version  is  shown,  then  the  analysis  is 
presented  (*.08  file).  Second,  the  analysis  is  shown  in  the  following  order;  construct  Cronbach  Alpha, 
construct  simple  Statistics,  preference  Cronbach  Alpha,  and  then  preference  simple  statistics. 


The  SAS  analysis  is  shown  in  the  following  order; 

1.  Entire  Data  Set  -  Version  A  through  Version  H . . page  77 

2.  Version  A  -  Non-Cohesive  White  Space  Cues . 85 

3.  Version  B  -  Non-Cohesive  Typographic  Cues . . . 91 

4.  Version  C  -  Non-Cohesive  Tense  Cues . 97 

5.  Version  D  -  Non-Cohesive  Syntax  Cues . 103 

6.  Version  E  -  Non-Cohesive  Visual  Cues,  Cohesive  Linguistic  Cues . 109 

7.  Version  F  -  Non-Cohesive  Linguistic  Cues,  Cohesive  Visual  Cues . 115 

8.  Version  G  -  All  Cues  Cohesive . 121 

9.  Version  H  -  All  Cues  Non-Cohesive . 127 

10.  Charts  and  Gratis . 133 
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Entire  Data  Set  -  Version  A  through  Version  H 


TITLE  'Entire  Data  Set'; 

OPTIONS  LINESIZE=80; 

INPUT  SUBJ  1-2  GRP  3  EIS  $  4-7  SEC  $  8-9 

VER  $  10  CUES  $  11-14  TIME  15-18  SCORE  19-20 
USEOl  21-22  COH02  23-24  COH03  25-26  REL04  27-28 

USE05  29-30  MAN06  31-32  QTY07  33-34  QLT08  35-36 

REL09  37-38  QTYIO  39-40  RELll  41-42  MAN12  43-44 

QTY13  45-46  QLT14  47-48  QLT15  49-50  MAN16  51-52 

P65  53-54  P66  55-56  P67  57-58  P68  59-60 

P69  61-62  D70  63  D71  64  D72  65 

D73  66; 

QTY13R  =  -1*(QTY13); 

CARDS  * 

IIDRP  PNANOWS  526  222222220  1-1  1  1-1  2120  1-1  0  12521 
IIDRP  EEBNOTY  812  3-1-1-1-2-1-1-1  O-l-l-l-l  1  0-1-1  0  1-1  0  12521 
IIBAFBPNCNOTS  564  611111110  1-1  1  1-1  0110  1-1  0  12521 
IIBAFBEEDNOSY  554  611111110  1-1  1  1-1  0110  1-1  0  12521 
22DRP  PNBNOTY  868  O-l-l-l-l-l-l  0  O-l-l-l-l  1  O-l-l-l  011  03523 
22DRP  EECNOTS  654  0-1  1  1-1-1  0-1  0  0-1  01000  1-1  011  03523 
22BAFBPNDNOSY  364  421112110101  1-1  0  0  1-1  011  03523 
22BAFBEEELING  414  711112200  1-1  11000  1-1  011  03523 
33DRP  PNCNOTS  650  321111110  1-1  1  1-1  0111111  14223 
33DRP  EEDNOSY  852  111111110111  1-1  0-1  11111  14223 
33BAFBPNELING  789  711110100  1-1  0021111111  14223 
33BAFBEEFVIS  363  1-1-1  11110000110  0-1  11111  14223 
44DRP  PNDNOSY  846  0-1-2  O-l-l-l  0-1-2  l-l-l-l  0-1-2  1110  02521 
44DRP  EEELING1061  8-1-1  1  0-1  2-1  0-1  1-1-1  0  1  1-1  1110  02521 
44BAFBPNFVIS  626  101111011101001111110  02521 
44BAFBEEGALL  503  1001001000001  0-1  001110  02521 
55DRP  PNELING  945  610211110  1-1  0  1-1  0011011  02521 
55DRP  EEFVIS  689  0-1-1  1-1-1  1-2  0-1  0-2-1-1  0-1  01011  02521 
55BAFBPNGALL  407  611111110  1-1  1  1-1  0011011  02521 
55BAFBEEHNONE  591  3-1  2  1  1-1  100101100011011  02521 
66BAFBEEANOWS  549  71111110010110  0-1  1-1  1  1-1  13513 
66DRP  PNFVIS  908  0111  0-1  000  1-1  101  0-1  1-1  1  1-1  13513 

66DRP  EEGALL  955  O-l-l-l  1-2-1  0010  1-1  0  0  1-1-1  1  1-1  13513 

66BAFBPNHNONE  850  6222222001012001  2-1  1  1-1  13513 
77BAFBPNANOWS  987  321111211  1-1  1  1-1  1111011  12311 
77BAFBEEBNOTY  701  3-1  0  1  1-1  010001  1-1  0001011  12311 
77DRP  PNGALL  1080  221112110  1-1  1  1-1  0011011  12311 
77DRP  EEHNONE  997  2  1-1  000110010  0-1  0101011  12311 
88DRP  EEANOWS1607  1-2  0000010010  0-2  0  0  0-1  0  0-1  04214 

88BAFBPNBNOTY  614  511011111  1-1  1  1-1  1  1  1-1  0  0-1  04214 

88BAFBEECNOTS  794  301000011101  1-2  1  1  1-1  0  0-1  04214 

88DRP  PNHNONElOlO  000000000110  0-2  0  0  0-1  0  0-1  04214 

91DRP  PNANOWS  700  0-1-1-1-2-1-2-2  0-2  1-2-1-1  0  0-2-2-1-2-1-23513 
91DRP  EEBNOTY  853  000100  1-1  0-1  100000  1-2-1-2-1-23513 
91BAFBPNCNOTS  705  6111111101011000  1-2-1-2-1-23513 
91BAFBEEDNOSY  720  6011101001101000  1-2-1-2-1-23513 
102DRP  PNBNOTY1183  110  0-1  1100  1-1  0  0-1  0010101  14524 
102DRP  EECNOTS1444  0  1  0-1-2  010  0-1  2-1  0-1  0100101  14524 
102BAFBPNDNOSY  845  811121200  1-1  1  1-1  0110101  14524 
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102BAFBEEELING  908  311 
113DRP  PNCNOTS1065  211 
113DRP  EEDNOSY  996  0-1-1- 
113BAFBPNELING  891  6  1-1- 
113BAFBEEFVIS  575  7  2  1 
124DRP  PNDNOSY1242  012 
124DRP  EEELING1347  211 
124BAFBPNFVIS  853  5  2  2 
124BAFBEEGALL  685  312 
135DRP  PNELING1286  5  0-1 
135DRP  EEFVIS  914  0-1-1- 
135BAFBPNGALL  52610  1  1 
135BAFBEEHNONE  45410  1  1 
146BAFBEEANOWS  745  411 
146DRP  PNFVIS  1395  211 
146DRP  EEGALL  1098  3-1-1* 
146BAFBPNHNONE  399  5  0  0 
157BAFBPNANOWS  391  611 
157BAFBEEBNOTY  41010  1  1 
157DRP  PNGALL  755  3-1  0 

157DRP  EEHNONE  667  3  0  0 

168DRP  EEANOWS  757 

168BAFBPNBNOTY  523 
168BAFBEECNOTS  570 
168DRP  PNHNONE  569 

171DRP  PNANOWS  726 

171DRP  EEBNOTY  706 

171BAFBPNCNOTS  564 
171BAFBEEDNOSY  532 
182DRP  PNBNOTY  822 

182DRP  EECNOTS  627 

182BAFBPNDNOSY  450 
182BAFBEEELING  426 
204DRP  PNDNOSY1042 
204DRP  EEELING  677 
204BAFBPNFVIS  798 
204BAFBEEGALL  1123 
215DRP  PNELING1105 
■215DRP  EEFVIS  1156 
215BAFBPNGALL  801 
215BAFBEEHNONE  670 
226BAFBEE7\NOWS  53610 
226DRP  PNFVIS  1022  5 
226DRP  EEGALL  875  1 
226BAFBPNHNONE1163  3 
237BAFBPNANOWS  658  6 
237BAFBEEBNOTY  441  3  2  2 
237DRP  PNGALL  1429  222 
237DRP  EEHNONE  674  022 
248DRP  EEANOWS1199  0  0-1 
248BAFBPNBNOTY  326  600 
248BAFBEECNOTS  399  3  1-1 
248DRP  PNHNONE  863  2-1-1 
262DRP  PNBNOTY  872  3  1-2 
262DRP  EECNOTS  681  7  1-1 
262BAFBPNDNOSY  43810  1  1 
262BAFBEEELING  613  3-2-2 
273DRP  PNCNOTS  955  6-1-1 
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1-1 
1-2- 
1  1 


1 

1- 

1 

1 


0-1-1-1-1-1-2 
0  0 


0-2 


0-1 
1  1 
1-1 
1-1 
1-2 
1-1 
1  1 
1  1 
1  1 
1-1 
1  2 
1  1 
1-1 
1  0 
2  0 
•1-1' 
0  0 
1-1 
1  1 
1-1 
0  1 
1  0 
-1-2 
0  1 
2  2 


0-1 
0  1 
1  1 
1  1 
0  0 
1-2-1“ 
110 
1  1 
1  1 
0-1 
1  0- 
1-1  1 
111 
1  1-1 
110 
1  1-1- 
1-1-1- 
111 
111 
111 
1-1-1 
111 
111 
0  0-1 
1-1  0- 
10  0 
1-1-2 
1-1-1 
0-1  0 
111 
0-1  1 
1  0-1 
1  0-1 
0-1-1 
1  0-1 
2  2 
2 
2 
2 
0 

1-1-1 
10  0 
0-1-1 
1-2-2 
-2-2-2 
1  0-1 
-1  0-2 
1  1-1 


1-1 
0-1 
0-1 
1-2  0- 
1-1  0 
1-1 
0-1 
2  2 
2-1 
0  1-1 
0-1  0 
0-1 
1  0 
1-1 
0-1 


1  2 
1-1 
1-1 
1-1 
1  2 
1  1 
1  1 
2  1 
1  2 
1-1- 
1  0- 


1-1- 
0  0 
1  1 
1  1 
0-1 
1-1 
0-1 
1-1 
1  1- 
0  0 
1  1 
1-1 
1  1 


1-1 
0  0 


0-1 
1  1 
1  0 
1  1 
0-1 
0  0 


0-1 


0-1 
0  0' 
1  0* 
1  0 
0-1 
0-1 
0  1- 
0  1- 
0-1 
0-1 
0-L 
0  1- 
1-1 
1-1 
1-1 
1-1 
0-1 
0-1 
0  1 
0-1 
0  0 
0  0 
0-1 
0  0 


1-1 
1-1 
1-1- 
0-1- 
0-2 
1  0 
-1-1 
-1  0 
-1  1 


0-1 

O-l- 

1-1 

1-2 

0-2 

0-2 

0-1 

0-1 

0-1 


1-1 
1  0 
1  0 
1  1 
1-1 
2-1- 
1  0 
1  0 
1-1 
2-1 
1-1- 
1-1- 
1  1 
1  1 
1-1 
2-1- 
1-1 
1-1 
2  0- 
2-1- 
1  0 
1  0- 
0-1 
1-1- 
*1  1 
'1-1- 
0  0- 
1  0- 
-1-1- 
0-1- 
-1  2 
-1  2 
-1  2 
-1  2 
1-1- 
-1-1‘ 
0-1 
1  0 
2-1 
2  0 
0  0 
0  0 
-1-1 


-1-1-1 


0-1 
1-1 
1-1 
0-1 
1-1 
1-1 
1-1 
1-1 
0-2 
1-1 
-1-1 
1  1 
1-1 


1-1  0 


1-1 
1-1 
1-1 
1-1 
1-2 
1-1 
1-1 
0-1 
1-1 
1-1 
1-1 
■1  0 
1-1 
-1  0-1 
■10  0 
2-1 
2-1 
2-1 
2-1 
-1-1 
-1-1-1 
0  0-1 
-1-1  0 
-2  2  0 
-2  0 
-1  0 
0  0 


0-1 
1  1 
1  1 
1  1 
0-1 
0  0 
0-1- 
0  1- 
0  1- 
0  0- 
0-1- 
-1-1- 
-1  1- 
1  1- 
1  1* 
1-1- 
-1  1- 
-1  1- 
1-1 
1-1 
1-1 
1-1 
0-1 
0  0 
1  1 
0-1 
0  0 
0-1 
-1-1 
0-1 
2  2 


-1-1 
1-1 
1-1 
-1-1 
-2  2 


-1-1  0 


2 
2 
2 
1 
2-1 
1-1 
2-1 
-1-2 
0-2 
0-1 
1-1 
0-1 


0-2- 
0-2- 
0-2- 
2  0 
2  0 
2  0 
2  0 
1-1- 
1-1- 
1-1- 
1-1- 
1-1- 
1-1- 
1-1- 
1-1- 
0  0 
0  0 
0  0 
0  0 
-1-1 


-2-2- 
-2-2- 
-2-2- 
2-2- 
1  1 
1  1 
1  1 
1  1 
-1-1- 
-1-1- 
-1-1 
-1-1- 
-1-1 
-1-1 
-1-1 
-1-1 
0  0 
0  0 
0  0 
0  0 
1  1 


14524 

22423 

22423 

22423 

22423 

23521 

23521 

23521 

23521 

12521 

12521 

12521 

12521 

14214 

14214 

14214 

14214 

12521 

12521 

12521 

12521 

22521 

22521 

22521 

22521 

12311 

12311 

12311 

12311 

01521 

01521 

01521 

01521 

12523 

12523 

12523 

12523 

-22513 

-22513 

-22513 

-22513 

11115 

11115 

11115 

11115 

-11421 

-11421 

-11421 

-11421 

03423 

03423 

03423 

03423 

03513 

03513 

03513 

03513 

13521 
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273DRP  EEDNOSY  668  0  l-l-l-l-l-l  0  O-l-l-l-l-l 
273BAFBPNELING  696  611111100  1-1  1  1-1 
273B7VFBEEFVTS  674  71111110010110 
284DRP  PNDNOSY  919  5-1-1-1-1-2-1-1  0-1  1-1-1  1 
284DRP  REELING  539  O-l-l-l-l-l-l-l  0-1  l-l-l-l 
284BAFBPNFVIS  360  611111110  1-1  1  1-1 
284BAFBEEGALL  466  711111100  1-1  1  1-1 
295DRP  PNELING1447  5-1-1  l-l-l-l  0  O-l-l-l-l  1 
295DRP  EEEVIS  1456  2-2-1-2-1-2-1  0  0-1  1-1-1  1 
295BAFBPNGALL  651  611111100  1-1  1  1-1 
295BAFBEEHNONE  875  501111100101  1-1 
306BAFBEEANOWS  801  70011011000000 
306DRP  PNFVTS  1077  2  O-l-l-l-l-l-l  O-l-l-l-l  0 
306DRP  EEGALL  719  1-1  0  1  1  1  0  0  0  0  1-1  0-1 
306BAFBPNHNONE  911  300000000000  1-1 
317BAFBPNANOWS  684  622112211  2-2  1  1-2 
317BAFBEEBNOTY  541  7111221211-2110 
317DRP  PNGALL  1024  011101  2-1  0  1-2  111 
317DRP  EEHN0NE1122  0-1-1  0  0-1  1-1  O-l-l-l-l  0 
328DRP  EEANOWS  679  5-2-2-2-2-2-2-2  0-2  l-l-l-l 
328BAFBPNBNOTY  311  62222222020220 
328BAFBEECNOTS  373  32222222020220 
328DRP  PNHNONE  872  3-1-1  O-l-l-l-l  1-2  0-1-1  0 
RUN; 

PROC  CORR  ALPHA; 

VAR  COH02  COHOS; 

RUN; 

PROC  FREQ; 

TABLES  COH02  COHOS; 

RUN; 

PROC  CORR  ALPHA; 

VAR  QLT08  QLT14  QLT15; 

RUN; 

PROC  FREQ; 

TABLES  QLT08  QLT14  QLT15; 

RUN; 

PROC  CORR  ALPHA; 

VAR  MAN06  MAN12  MAN16; 

RUN; 

PROC  FREQ; 

TABLES  MAN06  MAN12  MAN16; 

RUN; 

PROC  CORR  ALPHA; 

VAR  REL04  REL09  RELll; 

RUN; 

PROC  FREQ; 

TABLES  REL04  REL09  RELll; 

RUN; 

PROC  CORR  ALPHA; 

VAR  QTY07  QTYIO  QTY13; 

RUN; 

PROC  FREQ; 

TABLES  QTY07  QTYIO  QTY13; 

RUN; 

PROC  CORR  ALPHA; 

VAR  QTYIO  QTY13R; 

RUN; 

PROC  FREQ; 


0  O-l-l-l  1 
0  0  1-1-1  1 
0  0  1-1-1  1 
0  0-1-1  1  1 
0  1-1-1  1  1 
011-111 
011-111 
00-1111 
00-1111 
0  0  1111 
0  0  1111 
0  0  O-l-l-l 
0  O-l-l-l-l 
0  0  O-l-l-l 

0  0  o-l-l-l 
112  2-2-1 
001  2-2-1 
001  2-2-1 
0  0-2  2-2-1 
0  0-2-1-1  2 
0  0  2-1-1  2 
0  0  2-1-1  2 
O-l-l-l-l  2 


1 

1 

1 

1 

1 

1 

1 

1 

1 

1 

1 

1 

1 

1 

1 

2 

2 

2 

2 

2 

2 

2 

2 


13521 

13521 

13521 

13511 

13511 

13511 

13511 

13215 

13215 

13215 

13215 

13521 

13521 

13521 

13521 

12523 

12523 

12523 

12523 

22521 

22521 

22521 

22521 
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TABLES  QTYIO  QTY13R; 

RUN; 

PROG  CORR  ALPHA; 

VAR  USEOl  USE05; 

RUN; 

PROG  FREQ; 

TABLES  USEOl  USE05; 

RUN; 

PROG  GORR  ALPHA; 

VAR  USEOl  GOH02  GOH03  REL04  USE05  MAN06  QTY07  QLT08  REL09  QTYIO 
RELll  MAN12  QTY13  QTY13R  QLT14  QLT15  MAN16; 

RUN; 

PROG  FREQ; 

TABLES  USEOl  GOH02  GOH03  REL04  USE05  MAN06  QTY07  QLT08  REL09  QTYIO 
RELll  MAN12  QTY13  QTY13R  QLT14  QLT15  MAN16; 

RUN; 

PROG  GORR  ALPHA; 

VAR  P65  P66  P67  P68  P69; 

RUN; 

PROG  FREQ; 

TABLES  P65  P66  P67  P68  P69; 

RUN; 
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LIS  File  TResults^ 


Entire  Data  Set 

2  *VAR*  Variables:  COH02  COH03 
Cronbach  Coefficient  Alpha 
for  RAW  variables  :  0.788413 

for  STANDARDIZED  variables:  0.799862 

Raw  Variables  Std.  Variables 

Deleted  Correlation  Correlation 

Variable  with  Total  Alpha  with  Total  Alpha 


COH02  0.666474  -  0.666474 

COH03  0.666474  .  0.666474 


3  *VAR*  Variables:  QLT08  QLT14  QLT15 
Cronbach  Coefficient  Alpha 
for  RAW  variables  :  0.836742 

for  STANDARDIZED  variables:  0.857541 

Raw  Variables  Std.  Variables 

Deleted  Correlation  Correlation 

Variable  with  Total  Alpha  with  Total  Alpha 


QLT08  0.722385  0.762870  0.740912  0.791126 
QLT14  0.781449  0.716583  0.793566  0.740516 
QLT15  0.661800  0.863357  0.662233  0.863499 


3  ’VAR*  Variables:  MAN06  MAN12  MAN16 
Cronbach  Coefficient  Alpha 
for  RAW  variables  :  0.924117 

for  STANDARDIZED  variables:  0.924519 

Raw  Variables  Std.  Variables 

Deleted  Correlation  Correlation 

Variable  with  Total  Alpha  with  Total  Alpha 


MAN06  0.805918  0.921552  0.804053  0.924311 
MAN12  0.841936  0.894731  0.840109  0.895602 
MAN16  0.894810  0.849763  0.895443  0.850282 


3  *VAR*  Variables:  REL04  REL09  RELll 
Cronbach  Coefficient  Alpha 
for  RAW  variables  :  0.919515 

for  STANDARDIZED  variables:  0*920004 

Raw  Variables  Std.  Variables 

Deleted  Correlation  Correlation 

Variable  with  Total  Alpha  with  Total  Alpha 


REL04  0.802835  0.912295  0.800601  0.914509 
REL09  0.892771  0.836605  0.893481  0.838203 
RELll  0.821203  0.898260  0.820777  0.898305 
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QTY13 


3  'VAR'  Variables:  QTY07  QTYIO 
Cronbach  Coefficient  Alpha 
for  RAW  variables  :  -1.23746 

for  STANDARDIZED  variables:  -1.18364 


Raw  Variables 

Std. 

Variables 

Deleted 

Correlation 

Correlation 

Variable 

with  Total  Alpha 

with  Total 

Alpha 

QTY07 

-0.413780  -0.285529 

-0.403792 

-0.294846 

QTYIO 

-0.384684  -0.457504 

-0.370500 

-0.469202 

QTY13 

-0.276853  -1.043559 

-0.277871 

-1.044518 

2  'YAR'  Variables:  QTYIO 

QTY13R 

Cronbach  Coefficient  Alpha 

for  RAW  variables  : 

0.222110 

for  STANDARDIZED  variables: 

0*227707 

Raw  Variables 

Std. 

Variables 

Deleted 

Correlation 

Correlation 

Variable 

with  Total  Alpha 

with  Total 

Alpha 

QTYIO 

0.128482 

0.128482 

• 

QTY13R 

0.128482 

0.128482 

- 

2  'VAR'  Variables:  USEOl 

USE05 

Cronbach  Coefficient  Alpha 

for  RAW  variables  : 

0.854922 

for  STANDARDIZED  variables: 

0.856314 

Raw  Variables 

std. 

Variables 

Deleted 

Correlation 

Correlation 

Variable 

with  Total  Alpha 

with  Total 

Alpha 

USEOl 

0.748731  - 

0.748731 

. 

USE05 

0.748731 

0.748731 

• 
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17  *VAR’ 

Variables : 

USEOl  COH02 

COHO  3 

REL04 

USE05  MAN06 

QTY07  QLT08 

REL09 

QTYIO 

RELll  MAN12 

QTY13  QTY13R  QLT14 

QLT15 

MAN16 

Simple 

Statistics 

Variable 

N 

Mean 

Std  Dev 

Sum 

Minimum 

Maximum 

USEOl 

120 

0.35833 

1.10610 

43.00000 

-2,00000 

2.00000 

COHO  2 

120 

0.22500 

1.14100 

27.00000 

-2.00000 

2.00000 

COHO  3 

120 

0.63333 

0.91609 

76.00000 

-2,00000 

2.00000 

REL04 

120 

0.30000 

1.10461 

36.00000 

-2.00000 

2.00000 

USE05 

120 

0.15000 

1.19277 

18,00000 

-2.00000 

2.00000 

MAN06 

120 

0.40000 

1.06432 

48.00000 

-2.00000 

2.00000 

QTY07 

120 

0.19167 

0.99828 

23.00000 

-2.00000 

2.00000 

QLT08 

120 

0.19167 

0.59826 

23.00000 

-1.00000 

2.00000 

REL09 

120 

0.08333 

1.11960 

10.00000 

-2.00000 

2.00000 

QTYIO 

120 

-0.12500 

1.03358 

-15.00000 

-2.00000 

2.00000 

RELll 

120 

0.06667 

1.01859 

8.00000 

-2,00000 

2.00000 

MAN12 

120 

0.22500 

1.01636 

27.00000 

-2.00000 

2.00000 

QTY13 

120 

-0.59167 

0.81474 

-71.00000 

-2.00000 

2.00000 

QTY13R 

120 

0.59167 

0.81474 

71.00000 

-2.00000 

2.00000 

QLT14 

120 

0.19167 

0.58404 

23.00000 

-1.00000 

2.00000 

QLT15 

120 

0.23333 

0.82740 

28.00000 

-2.00000 

2.00000 

M7\N16 

120 

0.20833 

1.12941 

25.00000 

-2.00000 

2.00000 

Cronbach  Coefficient  Alpha 
for  RAW  variables  :  0.905522 

for  STANDARDIZED  variables:  0.897753 


Raw  Variables  Std.  Variables 


Deleted 

Variable 

Correlation 
with  Total 

Alpha 

Correlation 
with  Total 

Alpha 

USEOl 

0.694938 

0.895928 

0.687234 

0.887443 

COH02 

0.847235 

0.890170 

0.836500 

0.882249 

COHOS 

0.680777 

0.897014 

0.664055 

0.888236 

REL04 

0.819858 

0.891405 

0.808494 

0.883234 

USE05 

0.841567 

0.890125 

0.822816 

0.882731 

MAN06 

0.784220 

0.892907 

0.771636 

0.884523 

QTY07 

0.725358 

0.895230 

0.731159 

0.885929 

QLT08 

0.509138 

0.902806 

0.538870 

0.892464 

REL09 

0.860989 

0.889785 

0.846734 

0.881888 

QTYIO 

-0.512934 

0.932105 

-0.497151 

0.923858 

RELll 

0.819625 

0.891986- 

0.811715 

0.883121 

MAN12 

0.849383 

0.891000 

0.828237 

0.882540 

QTY13 

-0.230038 

0.919819 

-0.253606 

0.917031 

QTY13R 

0.080082 

0.912609 

0.068415 

0.907494 

QLT14 

0.525823 

0;902583 

0.556968 

0.891859 

QLT15 

0.521160 

0.901720 

0.551304 

0.892049 

MAN16 

0.886492 

0.888751 

0.865170 

0.881235 

83 


5 


Variable 

P65 

P66 

P67 

P68 

P69 


Deleted 

Variable 


P65 

P66 

P67 

P68 

P69 


Correlation  Analysis 


V  Variables:  P65 

P66 

P67 

P68 

P69 

N 

Simple 

Mean 

Statistics 
Std  Dev 

Sum 

Minimum 

Maximum 

120 

-0.03333 

1.11471 

-4.00000 

-2.00000 

2.00000 

120 

0.16667 

1.13266 

20.00000 

-2.00000 

2.00000 

120 

0.23333 

1.12072 

28.00000 

-2.00000 

2.00000 

120 

0.60000 

1.08775 

72.00000 

-2.00000 

2.00000 

120 

0.63333 

0.98675 

76.00000 

-2.00000 

2.00000 

Cronbach  Coefficient  Alpha 
for  RAW  variables  :  0.702298 

for  STANDARDIZED  variables:  0.711967 

Raw  Variables  Std.  Variables 

Correlation  Correlation 

with  Total  Alpha  with  Total  Alpha 


0.178582 

0.338641 

0.518862 

0.564463 

0.782351 


0.763652 

0.703859 

0.627033 

0.607863 

0.522797 


0,181391 

0.346556 

0.525991 

0.574457 

0.783602 


0.771831 

0.712131 

0.640486 

0.619861 

0.524330 
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Version  A  ■*  Non-Cohesive  White  Space  Cues 


.SAS  Program  File 

TITLE  ’Version  A  -  Non-Cohesive  White  Space  Cues'; 

OPTIONS  LINESIZE=80; 

DATA  dataset; 

INPUT  SUBJ  1-2  GRP  3  EIS  $  4-7  SEC  $  8-9 

VER  $  10  CUES  $  11-14  TIME  15-18  SCORE  19-20 
USEOl  21-22  COH02  23-24  COH03  25-26  REL04  27-28 

USE05  29-30  MAN06  31-32  QTY07  33-34  QLT08  35-36 

REL09  37-38  QTYIO  39-40  RELll  41-42  MAN12  43-44 

QTY13  45-46  QLT14  47-48  QLT15  49-50  MAN16  51-52 

P65  53-54  P66  55-56  P67  57-58  P68  59-60 

P69  61-62  D70  63  D71  64  D72  65 

D73  66; 

QTY13R  =  -1*(QTY13); 

CARDS; 


IIDRP  PNANOWS  526  22222222 
66BAFBEEANOWS  549  71111110 
77BAFBPNANOWS  987  32111121 
88DRP  EEANOWS1607  1-2  000001 
91DRP  PNANOWS  700  0-1-1-1-2-1-2-2 
146BAFBEEANOWS  745  41111111 
157BAFBPNANOWS  391  61111111 
168DRP  EEANOWS  757  4  0-1  1-1  1  0-1 
171DRP  PNANOWS  726  3-1-2  1  1-1-1  1 
226BAFBEEANOWS  53610  011  0-1  1  0 
2 37 BAFB PNANOWS  658  62222222 
248DRP  EEANOWS1199  0  0-1  1  0  0-1-1 
306BAFBEEANOWS  801  70011011 
3 17 BAFB PNANOWS  684  62211221 
328DRP  EEANOWS  679  5-2-2-2-2-2-2-2 
RUN; 

PROC  CORR  ALPHA; 

VAR  COH02  COHOS; 

RUN; 

PROC  FREQ; 

TABLES  COH02  COHOS; 

RUN; 

PROC  CORR  ALPHA; 

VAR  QLT08  QLT14  QLT15; 

RUN; 

PROC  FREQ; 

TABLES  QLT08  QLT14  QLT15; 

RUN; 

PROC  CORR  ALPHA; 

VAR  MAN06  MAN12  MAN16; 

RUN; 

PROC  FREQ; 

TABLES  MAN06  MAN12  MAN16; 

RUN; 

PROC  CORR  ALPHA; 

VAR  REL04  REL09  RELll; 

RUN; 

PROC  FREQ; 

TABLES  REL04  REL09  RELll; 


0  1-1  1  1-1  2120  1-1  0  12521 
010110  0-1  1-1  1  1-1  13513 
1  1-1  1  1-1  1111011  12311 
00100-200  0-1  0  0-1  04214 
0-2  1-2-1-1  0  0-2-2-1-2-1-23513 
0  1-1  1  1-1  0111000  14214 

1  1-1  0  1-1  1111111  12521 
0-1  1  0  1-1  0  0-1-1  201  22521 
0-1  l-l-l-l  0  O-l-l-l  2  2  12311 
000  0-1  00002011  11115 

2  2-1  2  2-1  2  2  2-1-1-1-1-11421 
0-1  l-l-l-l  0-1  0  l-l-l-l  03423 
00000000  O-l-l-l  1  13521 
1  2-2  1  1-2  112  2-2-1  2  12523 
0-2  l-l-l-l  0  0-2-1-1  2  2  22521 
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RUN; 

PROC  CORR  ALPHA; 

VAR  QTY07  QTYIO  QTY13; 

RUN; 

PROC  FREQ; 

TABLES  QTY07  QTYlO  QTY13; 

RUN; 

PROC  CORR  ALPHA; 

VAR  QTYIO  QTY13R; 

RUN; 

PROC  FREQ; 

TABLES  QTYIO  QTY13R; 

RUN; 

PROC  CORR  ALPHA; 

VAR  USEOl  USE05; 

RUN; 

PROC  FREQ; 

TABLES  USEOl  USE05; 

RUN; 

PROC  CORR  ALPHA; 

VAR  USEOl  COH02  COHOS  REL04  USE05  MAN06  QTY07  QLT08  REL09  QTYIO 
RELll  MAN12  QTY13  QTY13R  QLT14  QLT15  MAN16; 

RUN; 

PROC  FREQ; 

TABLES  USEOl  COH02  COHOS  REL04  USE05  MAN06  QTY07  QLT08  REL09  QTYIO 
RELll  MAN12  QTY13  QTY13R  QLT14  QLT15  MAN16; 

RUN; 

PROC  CORR  ALPHA; 

VAR  P65  P66  P67  P68  P69; 

RUN; 

PROC  FREQ; 

TABLES  P65  P66  P67  P68  P69; 

RUN; 
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IAS  FHe  (Results^ 


Version  A  -  Non-Cohesive  White  Space  Cues 


2  'VAR'  Variables:  COH02 

COHO  3 

Cronbach  Coefficient  Alpha 

for  RAW  variables  : 

0.768627 

for  STANDARDIZED  variables: 

0.789009 

Raw  Variables 

Std.  Variables 

Deleted 

Correlation 

Correlation 

Variable 

with  Total  Alpha 

with  Total  Alpha 

COH02 

0.651540 

0.651540 

COH03 

0.651540 

0.651540 

3  *VAR*  Variables:  QLT08  QLT14  QLT15 
Cronbach  Coefficient  Alpha 
for  RAW  variables  :  0.897129 

for  STANDARDIZED  variables:  0.902753 

Raw  Variables  Std.  Variables 

Deleted  Correlation  Correlation 

Variable  with  Total  Alpha  with  Total  Alpha 


QLT08  0.785351  0.877193  0.784728  0.879367 
QLT14  0-809707  0.842105  0.806488  0.861002 
QLT15  0.829925  0.833333  0.829054  0.841686 


3  ’VAR’  Variables:  MAN06  MAN12  MAN16 
Cronbach  Coefficient  Alpha 
for  RAW  variables  :  0.930337 

for  STANDARDIZED  variables:  0.935301 

Raw  Variables  Std.  Variables 

Deleted  Correlation  Correlation 

Variable  with  Total  Alpha  with  Total  Alpha 


0.915639  0.856597  0.908129  0.872545 
0.800201  0.956407  0.799957  0.957113 
0.903813  0.861210  0.893380  0.884405 


MAN06 

MAN12 

MAN16 


3  ’VAR’  Variables:  REL04  REL09  RELll 
Cronbach  Coefficient  Alpha 
for  RAW  variables  :  0.939184 

for  STANDARDIZED  variables:  0.942515 

Raw  Variables  Std.  Variables 

Deleted  Correlation  Correlation 

Variable  with  Total  Alpha  with  Total  Alpha 


REL04 

REL09 

RELll 


0.830199 

0.935075 

0.879801 


0.946619 

0.864097 

0.917197 


0.826322 

0.938383 

0.878016 


0.957084 

0.870238 

0.917748 


QTY13 


3  'YAR'  Variables:  QTY07  QTYIO 
Cronbach  Coefficient  Alpha 
for  RAW  variables  :  -2.23846 

for  STANDARDIZED  variables:  -1.23913 


Deleted 

Variable 

Raw  Variables 

Correlation 

with  Total  Alpha 

Std. 

Correlation 
with  Total 

Variables 

Alpha 

QTY07 

QTYIO 

QTY13 

-0.617914  0.193939 
-0.593280  -0.208333 
-0.033384  -3.917526 

-0.535403 

-0.418836 

0.000000 

0.221074 

-0.283819 

-4.222222 

2  'VAR'  Variables:  QTYIO 

QTY13R 

Cronbach  Coefficient  Alpha 

for  RAW  variables  : 

-.240602 

for  STANDARDIZED  variables: 

-.283819 

Raw  Variables 

std. 

Variables 

Deleted 

Correlation 

Correlation 

Variable 

with  Total  Alpha 

with  Total 

Alpha 

QTYIO 

-0.124274 

-0.124274 

. 

QTY13R 

-0.124274 

-0.124274 

- 

2  ’VAR*  Variables:  USEOl 

USE05 

Cronbach  Coefficient  Alpha 

for  RAW  variables  : 

0.923754 

for  STANDARDIZED  variables: 

0.927190 

Raw  Variables 

std. 

Variables 

Deleted 

Correlation 

Correlation 

Variable 

with  Total  Alpha 

with  Total 

Alpha 

USEOl 

0.864263 

0.864263 

. 

USE05 

0.864263 

0.864263 

• 
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17  'VAR' 


Variable 

USEOl 

COHO  2 

COHO  3 

REL04 

USE05 

MAN06 

QTY07 

QLT08 

REL09 

QTYIO 

REIill 

MAN12 

QTY13 

QTY13R 

QLT14 

QLT15 

MAN16 


Deleted 

Variable 


USEOl 

COH02 

COHO  3 

REL04 

USE05 

MAN06 

QTY07 

QLT08 

REL09 

QTYIO 

RELll 

MAN12 

QTY13 

QTY13R 

QLT14 

QLT15 

MAN16 


Variables: 

USEOl 

COH02 

COH03  REL04  USE05 

MAN06 

QTY07  QLT08  REL09  QTYIO  RELll 

QTY13  QTY13R  QLT14  QLT15  MAN16 

Simple  Statistics 

MAN12 

N 

Mean 

Std  Dev 

Sum  Minimum 

Maximuiti 

15 

0.33333 

1.39728 

5.00000  -2.00000 

2.00000 

15 

0.26667 

1.38701 

4.00000  -2.00000 

2.00000 

15 

0.73333 

1.03280 

11.00000  -2.00000 

2.00000 

15 

0.40000 

1.24212 

6.00000  -2.00000 

2.00000 

15 

0.40000 

1.24212 

6.00000  -2.00000 

2.00000 

15 

0.46667 

1.40746 

7.00000  -2.00000 

2.00000 

15 

0.33333 

1.29099 

5.00000  -2.00000 

2.00000 

15 

0.33333 

0.61721 

5.00000  0 

2.00000 

15 

0.13333 

1.30201 

2.00000  -2.00000 

2.00000 

15 

-0.06667 

1.03280 

-1.00000  -2.00000 

1,00000 

15 

0.13333 

1.06010 

2.00000  -2.00000 

2.00000 

15 

0.26667 

1.03280 

4.00000  -1.00000 

2.00000 

15 

-0.93333 

0.59362 

-14.00000  -2.00000 

0 

15 

0.93333 

0.59362 

14.00000  0 

2.00000 

15 

0.46667 

0.74322 

7.00000  0 

2.00000 

15 

0.33333 

0.81650 

5.00000  -1.00000 

2.00000 

15 

0.26667 

1.33452 

4.00000  -2.00000 

2.00000 

Cronbach  Coefficient  Alpha 
for  RAW  variables  :  0.934350 

for  STANDARDIZED  variables:  0.919491 


Raw  Variables  Std.  Variables 


Correlation 
with  Total 

Alpha 

Correlation 
with  Total 

Alpha 

0.868248 

0.924713 

0,867373 

0.907657 

0.885110 

0.924209 

0.875714 

0.907420 

0.796409 

0.927410 

0.776581 

0.910209 

0.864258 

0.925049 

0.851867 

0.908095 

0.890390 

0.924345 

0.888046 

0.907070 

0.938082 

0.922564 

0.925143 

0.906012 

0.827213 

0.925973 

0.825365 

0.908842 

0.634596 

0.932295 

0,651729 

0-913653 

0.951316 

0.922446 

0.942200 

0.905524 

-0.879706 

0.959808 

-0.878613 

0.950232 

0.908816 

0.924743 

0.901472 

0.906688 

0.842298 

0.926398 

0.847561 

0.908217 

-0.125510 

0.941376 

-0.190569 

0.935023 

0.035597 

0.939532 

0.015193 

0.930093 

0.764572 

0.929644 

0.780784 

0.910091 

0.652519 

0.931063 

0.674312 

0.913036 

0.954423 

0.922246 

0.941851 

0.905534 
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5 

’VAR’  Variables: 

P65  P66  P67 

P68 

P69 

Single  Statistics 

Variable 

N 

Mean 

Std  Dev  Sum 

Minimum 

Maximum 

P65 

15 

-0.06667 

1.27988  -1.00000 

-2.00000 

2.00000 

P66 

15 

-0.20000 

1.08233  -3.00000 

-2.00000 

2.00000 

P67 

15 

0.06667 

1.22280  1.00000 

-2.00000 

2.00000 

P68 

15 

0.40000 

1.18322  6.00000 

-1.00000 

2.00000 

P69 

15 

0.66667 

1.04654  10.00000 

-2.00000 

2.00000 

Cronbach  Coefficient  Alpha 

for  RAW  variables  :  0. 

665903 

for  STANDARDIZED  variables:  0. 

674861 

Raw  Variables 

Std.  Variables 

Deleted 

Correlation 

Correlation 

Variable 

with  Total 

Alpha  with  Total 

Alpha 

P65 

0.216972 

0,711417 

0.217122 

0.712741 

P66 

0.115753 

0.732724 

0.128336 

0.746799 

P67 

0.548222 

0.549930 

0.561710 

0.561857 

P68 

0.515615 

0.568151 

0.509259 

0.586841 

P69 

0.821436 

0.433934 

0.828665 

0.422626 
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Version  B  -  Non-Cohesive  Typographic  Cues 

.SAS  Program  File 


TITLE  'Version  B  -  Non-Cohesive  Typographic  Cues'; 

OPTIONS  LINESIZE=80; 

DATA  dataset; 

INPUT  SUBJ  1-2  GRP  3  EIS  $  4-7  SEC  $  8-9 

VER  $  10  CUES  $  11-14  TIME  15-18  SCORE  19-20 
USEOl  21-22  COH02  23-24  COH03  25-26  REL04  27-28 

USE05  29-30  MAN06  31-32  QTY07  33-34  QLT08  35-36 

REL09  37-38  QTYIO  39-40  RELll  41-42  MAN12  43-44 

QTY13  45-46  QLT14  47-48  QLT15  49-50  MAN16  51-52 

P65  53-54  P66  55-56  P67  57-58  P68  59-60 

P69  61-62  D70  63  D71  64  D72  65 

D73  66; 

QTY13R  =  -1*(QTY13) ; 

CARDS; 


IIDRP  EEBNOTY  812  3-1-1-1-2-1-1-1 
22DRP  PNBNOTY  868  O-l-l-l-l-l-l  0 
77BAFBEEBNOTY  701  3-1  0  1  1-1  0  1 
88BAFBPNBNOTY  614  51101111 
88BAFBEECNOTS  7 94  30100001 
91DRP  EEBNOTY  853  000100  1-1 
102DRP  PNBNOTY1183  110  0-1  110 
157BAFBEEBNOTY  41010  1111111 
168BAFBPNBNOTY  523  611111  1-1 
171DRP  EEBNOTY  706  9-1-1  l-l-l-l-l 
182DRP  PNBNOTY  822  01111111 
237BAFBEEBNOTY  441  32222222 
248BAFBPNBNOTY  326  600  l-l-l-l-l 
262DRP  PNBNOTY  872  3  1-2  1-2-2  0-2 
317BAFBEEBNOTY  54 171112212 
328BAFBPNBNOTY  311  62222222 
RUN; 

PROC  CORR  ALPHA; 

VAR  COH02  COHO 3 ; 

RUN; 

PROC  FREQ; 

TABLES  COHO 2  COHO 3; 

RUN; 

PROC  CORR  ALPHA; 

VAR  QLT08  QLT14  QLT15; 

RUN; 

PROC  FREQ; 

TABLES  QLT08  QLT14  QLT15; 

RUN; 

PROC  CORR  ALPHA; 

VAR  MAN06  MAN12  MAN16; 

RUN; 

PROC  FREQ; 

TABLES  MAN06  MAN12  MAN16; 

RUN; 

PROC  CORR  ALPHA; 

VAR  REL04  REL09  RELll; 

RUN; 

PROC  FREQ; 


O-l-l-l-l  1  0-1-1  0  1-1  0  12521 
O-l-l-l-l  1  O-l-l-l  oil  03523 
00011-10001011  12311 
1  1-1  1  1-1  1  1  1-1  0  0-1  04214 
1101  1-2  1  1  1-1  0  0-1  04214 
0-1  100000  1-2-1-2-1-23513 
0  1-1  00-10010101  14524 

1  1-1  1  1-1  1111111  12521 
0  0-1  0  1-1  0  0  1-1  201  22521 
0-1  l-l-l-l  O-l-l-l-l  2  2  12311 
0-1  1-1  1-1  0  1  1-2  2-2  2  01521 

2  2-1  2  2-1  2  2  2-1-1-1-1-11421 
0-1-1-1-1-1-1-2-1  l-l-l-l  03423 
0-2  2-1-2  2  0-1-2  0000  03513 
i  1-2  1  1  0  0  0  1  2-2-1  2  12523 
02022000  2-1-1  2  2  22521 
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TABLES  REL04  REL09  RELll; 

RUN; 

PROC  CORR  ALPHA; 

VAR  QTY07  QTYIO  QTY13; 

RUN; 

PROC  FREQ; 

TABLES  QTY07  QTYIO  QTY13; 

RUN; 

PROC  CORR  ALPHA; 

VAR  QTYIO  QTY13R; 

RUN; 

PROC  FREQ; 

TABLES  QTYIO  QTY13R; 

RUN; 

PROC  CORR  ALPHA; 

VAR  USEOl  USE05; 

RUN; 

PROC  FREQ; 

TABLES  USEOl  USE05; 

RUN; 

PROC  CORR  ALPHA/ 

VAR  USEOl  COH02  COHOS  REL04  USE05  MAN06  QTY07  QLT08  REL09  QTYIO 
RELll  MAN12  QTY13  QTY13R  QLT14  QLT15  MAN16; 

RUN; 

PROC  FREQ; 

TABLES  USEOl  COH02  COHOS  REL04  USE05  MAN06  QTY07  QLT08  REL09  QTYIO 
RELll  MAN12  QTY13  QTY13R  QLT14  QLT15  MAN16; 

RUN; 

PROC  CORR  ALPHA; 

VAR  P65  P66  P67  P68  P69; 

RUN; 

PROC  FREQ; 

TABLES  P65  P66  P67  P€8  P69; 

RUN; 
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XIS  File  (Results) 

Version  B  -  Non-Cohesive  Typographic  Cues 


2  'VAR’  Variables:  COH02  COH03 
Cronbach  Coefficient  Alpha 
for  RAW  variables  :  0.657609 

for  STANDARDIZED  variables:  0.673036 


Deleted 

Variable 

Raw  Variables 

Correlation 

with  Total  Alpha 

Std. 

Correlation 
with  Total 

Variables 

Alpha 

COH02 

COHO  3 

0.507200 

0.507200 

0.507200 

0.507200 

II 

II 

II 

II 

II 

II 

11 

•  •  II 

II 

II 

II 

II 

11 

11 

II 

II 

3  'V3\R'  Variables;  QLT08 

QLT14  QLT15 

Cronbach  Coefficient  Alpha 

for  RAW  variables 

:  0.898955 

for  STANDARDIZED  variables 

:  0.929967 

Raw  Variables 

std. 

Variables 

Deleted 

Correlation 

Correlation 

Variable 

with  Total  Alpha 

with  Total 

Alpha 

QLT08 

0.814112  0.878049 

0.830002 

0.919164 

QLT14 

0.916602  0.783217 

0.923302 

0.843797 

QLT15 

0.820783  0.926316 

0.817786 

0.928718 

3  ’VAR’  Variables:  MAN06 

MAN12  MAN16 

Cronbach  Coefficient  Alpha 

for  RAW  variables 

:  0.951700 

for  STANDARDIZED  variables 

:  0.952939 

Raw  Variables 

std. 

Variables 

Deleted 

Correlation 

Correlation 

Variable 

with  Total  TU-pha 

with  Total 

Alpha 

MAN06 

0.855244  0.964794 

0.855100 

0.964807 

MAN12 

0.899089  0.929902 

0.894035 

0.935894 

MAN16 

0.956150  0.884328 

0.954392 

0.889732 

1 

3  'VAR'  Variables:-  REL04 

REL09  RELll 

Cronbach  Coefficient  Alpha 

for  RAW  variables 

:  0.924425 

for  STANDARDIZED  variables:  0.931328 

Raw  Variables 

std. 

Variables 

Deleted 

Correlation 

Correlation 

Variable 

with  Total  Alpha 

with  Total 

Alpha 

REL04 

0.785900  0.952532 

0.787864 

0.955500 

REL09 

0.858442  0.880597 

0.869101 

0.892091 

RELll 

0.919560  0.845506 

0.922918 

0.848320 
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3  'VAR'  Variables:  QTY07  QTYIO  QTY13 
Cronbach  Coefficient  Alpha 


for  RAW  variables  : 

for  STANDARDIZED  variables: 

-1.23633 

-1.01030 

Deleted 

Variable 

Raw  Variables 

Correlation 

with  Total  Alpha 

Std. 

Correlation 
with  Total 

Variables 

Alpha 

QTY07 

QTYIO 

QTY13 

-0.530991  0.371951 
-0.239186  -1.350384 
-0.222588  -1.403509 

-0.530992 

-0.175756 

-0.171272 

0.372257 

-1.408944 

-1.442809 

2  'VAR'  Variables:  QTYIO  QTY13R 

Cronbach  Coefficient  Alpha 
for  RAW  variables  :  -.592233 

for  STANDARDIZED  variables:  -.593010 

Deleted 

Variable 

Raw  Variables 

Correlation 

with  Total  Alpha 

Std. 

Correlation 
with  Total 

Variables 

Alpha 

QTYIO 

QTY13R 

-0*228696 

-0.228696 

-0.228696 

-0.228696 

- 

II 

il 

II 

II 

i 

1 

1 

1 

1 

I 

1 

2  'VAR'  Variables:  USEOl  USE05 

Cronbach  Coefficient  Alpha 
for  RAW  variables  :  0.853893 

for  STANDARDIZED  variables:  0.866209 

Deleted 

Variable 

Raw  Variables 

Correlation 

with  Total  Alpha 

Std. 
Correlation 
with  Total 

Variables 

Alpha 

USEOl 

USE05  ■ 

0.763994 

0.763994 

0.763994 

0.763994 

■ 
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17  'VAR'  Variables:  USEOl 

QTY07 

QTY13 


COH02  COHOS 
QLT08  REL09 
QTY13R  QLT14 


REL04 

QTYIO 

QLT15 


USE05 

RELll 

MAN16 


MAN06 

MAN12 


Variable 

USEOl 

COHO  2 

COHO  3 

REL04 

USE05 

MAN06 

QTY07 

QLT08 

REL09 

QTYIO 

RELll 

MAN12 

QTY13 

QTY13R 

QLT14 

QLT15 

MAN16 


Simple  Statistics 


N 

Mean 

Std  Dev 

Sum 

Minimum 

Maximum 

16 

0.43750 

1.03078 

7.00000 

-1.00000 

2.00000 

16 

0.31250 

1.13835 

5.00000 

-2.00000 

2.00000 

16 

0.68750 

0.87321 

11.00000 

-1.00000 

2.00000 

16 

0.18750 

1.37689 

3.00000 

”2.00000 

2.00000 

16 

0.25000 

1.29099 

4.00000 

-2.00000 

2,00000 

16 

0.43750 

1.03078 

7.00000 

”1.00000 

2.00000 

16 

0.25000 

1.29099 

4.00000 

-2.00000 

2.00000 

16 

0.37500 

0.61914 

6.00000 

0 

2.00000 

16 

0.06250 

1.23659 

1.00000 

-2.00000 

2.00000 

16 

”0.31250 

1.07819 

-5.00000 

”2.00000 

2.00000 

16 

0.18750 

1.10868 

3.00000 

-1.00000 

2.00000 

16 

0.31250 

1.19548 

5.00000 

”2,00000 

2.00000 

16 

-0.43750 

1.03078 

-7.00000 

-2.00000 

2.00000 

16 

0.43750 

1.03078 

7.00000 

”2.00000 

2.00000 

16 

0.25000 

0.68313 

4.00000 

-1.00000 

2.00000 

16 

0 

1.03280 

0 

”2.00000 

2.00000 

16 

0.37500 

1.20416 

6.00000 

-2.00000 

2.00000 

Cronbach  Coefficient  Alpha 
for  RAW  variables  :  0,926207 

for  STANDARDIZED  variables:  0.923643 


Deleted 

Variable 


USEOl 

COH02 

COHOS 

REL04 

USE05 

MAN06 

QTY07 

QLT08 

REL09 

QTYIO 

RELll 

MAN12 

QTY13 

QTY13R 

QLT14 

QLTIS 

MAN16 


Raw  Variables 


Correlation 
with  Total 

Alpha 

0.719872 

0.919727 

0.918224 

0.914085 

0.534976 

0.924115 

0.889824 

0.913979 

0.876182 

0.914617 

0.885241 

0.915681 

0.807114 

0.916763 

0.640885 

0.923320 

0.844738 

0.915735 

-0.337617 

0.944075 

0.866906 

0.915656 

0.938629 

0.913150 

-0.544438 

0.947325 

0.418963 

0.926821 

0.617356 

0.923275 

0.827744 

0.917088 

0.920652 

0.913627 

Std.  Variables 


Correlation 
with  Total 

Alpha 

0.723108 

0.916513 

0.903524 

0.911681 

0.525471 

0.921640 

0.877886 

0.912376 

0.862790 

0.912785 

0.880113 

0.912316 

0.798286 

0.914517 

0.653733 

0.918333 

0.841333 

0.913363 

-0.324311 

0.941785 

0.867270 

0.912664 

0.923551 

0.911135 

-0.542569 

0.946489 

0.407410 

0.924620 

0.637151 

0.918764 

0.843983 

0.913292 

0.906622 

0.911596 
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5  'VAR*  Variables:  P65 


P66  P67  P68  P69 


Simple  Statistics 


Variable 

N 

Mean 

Std  Dev 

Sum 

Minimum 

P65 

16 

”0.37500 

1.14746 

-6.00000 

-2.00000 

P66 

16 

0 

1.15470 

0 

-2.00000 

P67 

16 

-0.06250 

1.23659 

-1.00000 

-2.00000 

P68 

16 

0.50000 

1.21106 

8.00000 

-1.00000 

P69 

16 

0.43750 

1.03078 

7.00000 

-2.00000 

Cronbach  Coefficient  Alpha 
for  RAW  variables  :  0.601643 

for  STANDARDIZED  variables:  0.613213 


Maximum 

2.00000 

2.00000 

2,00000 

2.00000 

2.00000 


Raw  Variables  Std.  Variables 

Deleted  Correlation  Correlation 

Variable  with  Total  Alpha  with  Total  Alpha 


P65 

P66 

P67 

P68 

P69 


0.129073 

0.017050 

0.398040 

0.554265 

0.861424 


0.658320 

0.708333 

0.523693 

0.429598 

0.277421 


0.137250 

0.026549 

0.405672 

0.559526 

0.860336 


0.669713 

0.717380 

0.538830 

0.453260 

0.261616 
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Version  C  •  Non-Cohesive  Tense  Cues 


.SAS  Program  File 


TITLE  'Version  C  -  Non- 
OPTIONS  LINESIZE=80; 
DATA  dataset; 

INPUT  SUBJ  1-2 

VER  $  10 
USEOl  21-22 
USE05  29-30 
REL09  37-38 
QTY13  45-46 
P65  53-54 

P69  61-62 

D73  66; 


Tense  Cues'; 


GRP 

3 

EIS 

CUES  $ 

11-14 

TIME 

COH02 

23-24 

COHO  3 

MftN06 

31-32 

QTY07 

QTYIO 

39-40 

RELll 

QLT14 

47-48 

QLT15 

P66 

55-56 

P67 

D70 

63 

D71 

$  4-7 

SEC 

$  8-9 

15-18 

SCORE 

19-20 

25-26 

REL04 

27-28 

33-34 

QLT08 

35-36 

41-42 

MAN12 

43-44 

49-50 

MAN16 

51-52 

57-58 

P68 

59-60 

64 

D72 

65 

QTY13R  =  -1* (QTY13) ; 


CARDS; 

22DRP  EECNOTS  654 
33DRP  PNCNOTS  650 
88BAFBEECNOTS  794 
102DRP  EECNOTS1444 
113DRP  PNCNOTS1065 
168BAFBEECNOTS  570 
182DRP  EECNOTS  627 
262DRP  EECNOTS  681 
273DRP  PNCNOTS  955 
328BAFBEECNOTS  373 


0-1  1  1-1-1  0-1  00-1010 
3211111101-111-1 
301000011101  1-2 
0  1  0-1-2  010  0-1  2-1  0-1 
2111  l-l-l-l  O-l-l-l  0-1 
2-1-1  1  1-1  1  1-1  0-1-1  1-1 
4-1-1  1-1-1  1  1  0-1  2-1-1-1 
7  1-1-2-2-2-1  0  0-2  2  0-2  0 
6-1-1  1  1-1-1  1  O-l-l-l-l-l 
32222222020220 


0 

0 

1 

0 

1 

0 

0 

0 

0 

0 


01-1011 
111111 
1  1-1  0  0-1 
10  0  10  1 
1-10202 
01-1201 
1-1-2  2-2  2 
0-20000 
O-l-l-l  1  1 
0  2-1-1  2  2 


03523 

14223 

04214 

14524 

22423 

22521 

01521 

03513 

13521 

22521 


RUN; 

PROC  CORR  ALPHA; 
VAR  COH02  COH03; 


RUN; 

PROC  FREQ; 

TABLES  COH02  COH03; 

RUN; 

PROC  CORR  ALPHA; 

VAR  QLT08  QLT14  QLT15; 
RUN; 

PROC  FREQ; 

TABLES  QLT08  QLT14  QLT15; 
RUN; 

PROC  CORR  ALPHA; 

VAR  M7VN06  MAN12  MAN16; 


RUN; 

PROC  FREQ; 

TABLES  MAN06  MAN12  MAN16; 


RUN; 

PROC  CORR  ALPHA; 

VAR  REL04  REL09  RELll; 
RUN; 

PROC  FREQ; 

TABLES  REL04  REL09  RELll; 
RUN; 

PROC  CORR  ALPHA; 

VAR  QTY07  QTYIO  QTY13; 
RUN; 

PROC  FREQ; 
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TABLES  QTY07  QTYIO  QTY13; 

RUN; 

PROC  CORR  ALPHA; 

VAR  QTYIO  QTY13R; 

RUN; 

PROC  FREQ; 

TABLES  QTYIO  QTY13R; 

RUN; 

PROC  CORR  ALPHA; 

VAR  USEOl  USE05; 

RUN; 

PROC  FREQ; 

TABLES  USEOl  USE05; 

RUN; 

PROC  CORR  ALPHA; 

VAR  USEOl  COH02  COH03  REL04  USE05  MAN06  QTY07  QLT08  REL09  QTYIO 
RELll  MAN12  QTY13  QTY13R  QLT14  QLT15  MAN16; 

RUN; 

PROC  FREQ; 

TABLES  USEOl  COH02  COHOS  REL04  USE05  MAN06  QTY07  QLT08  REL09  QTYIO 
RELll  MAN12  QTY13  QTY13R  QLT14  QLT15  MAN16; 

RUN; 

PROC  CORR  ALPHA; 

VAR  P65  P66  P67  P68  P69; 

RUN; 

PROC  FREQ; 

TABLES  P65  P66  P67  P68  P69; 

RUN; 
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.LIS  File  (Results) 

Version  C  -  Non-Cohesive  Tense  Cues 


2  'VAR*  Variables:  COH02  COH03 
Cronbach  Coefficient  Alpha 
for  RAW  variables  :  0.586510 

for  STANDARDIZED  variables:  0.586800 


Raw  Variables 

Std. 

Variables 

Deleted 

Correlation 

Correlation 

Variable 

with  Total  Alpha 

with  Total 

Alpha 

COHO  2 

0.415227 

0.415227 

. 

COH03 

0.415227 

0.415227 

• 

3  'V3\R'  Variables:  QLT08 

QLT14  QLT15 

Cronbach  Coefficient  Alpha 

for  RAW  variables 

:  0.743802 

for  STANDARDIZED  variables 

:  0.751554 

Raw  Variables 

std. 

Variables 

Deleted 

Correlation 

Correlation 

Variable 

with  Total  Alpha 

with  Total 

Alpha 

QLT08 

0.572598  0.655738 

0.580948 

0.666667 

QLT14 

0.620174  0.615385 

0.622475 

0.618034 

QLT15 

0.534522  0.714286 

0.536423 

0.717140 

3  'VAR'  Variables:  MAN06 

MAN12  MAN16 

Cronbach  Coefficient  Alpha 

for  RAW  variables 

:  0.911585 

for  STANDARDIZED  variables 

i:  0.909452 

Raw  Variables 

std. 

Variables 

Deleted 

Correlation 

Correlation 

Variable 

with  Total  Alpha 

with  Total 

Alpha 

MAN06 

0.676369  0.983957 

0.675477 

0.984478 

MAN12 

0.882843  0.820755 

0.865831 

0.829858 

MAN16 

0.939418  0.768831 

0.929306 

0.774056 

3  'VAR'  Variables:  REL04 

REL09  RELll 

Cronbach  Coefficient  Alpha 

for  RAW  variables 

:  0.807818 

for  STANDARDIZED  variables:  0.818389 

Raw  Variables 

std. 

Variables 

Deleted 

Correlation 

Correlation 

Variable 

with  Total  Alpha 

with  Total 

Alpha 

REL04 

0.532397  0.888889 

0.524276 

0.891907 

REL09 

0.860837  0.514139 

0.876558 

0.526118 

RELll 

0.624056  0.775194 

0.641701 

0.779846 
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3  'VAR'  Variables:  QTY07  QTYIO  QTY13 
Cronbach  Coefficient  Alpha 


for  RAW  variables  : 

0.030405 

for  STANDARDIZED  variables: 

-.037404 

Raw  Variables 

Std. 

Variables 

Deleted 

Correlation 

Correlation 

Alpha 

Variable 

with  Total 

Alpha 

with  Total 

QTY07 

-0.036481 

0.144796 

-0.093644 

0.186047 

QTYIO 

0.099504 

-0.396040 

0.112718 

-0.441333 

QTY13 

-0.020515 

0.075758 

-0.054185 

0.080093 

2  'VAR' 

Var i abl e  s :  QTYl 0 

QTY13R 

Cronbach  Coefficient  Alpha 

for  RAW 

variables  : 

-.169312 

for  STANDARDIZED  variables: 

-.228571 

Raw  Variables 

std. 

Variables 

Deleted 

Correlation 

Correlation 

Alpha 

Variable 

with  Total 

Alpha 

with  Total 

QTYIO 

-0.102564 

-0.102564 

. 

QTY13R 

-0.102564 

• 

-0.102564 

• 

2  'VAR' 

'  Variables:  USEOl 

USE05 

Cronbach  Coefficient  Alpha 

for  RAW 

variables  : 

0.764569 

for  STANDARDIZED  variables: 

0.765543 

Raw  Variables 

std. 

Variables 

Deleted 

Correlation 

Correlation 

Variable 

with  Total 

Alpha 

with  Total 

Alpha 

USEOl 

0.620145 

, 

0.620145 

. 

USE05 

0.620145 

• 

0.620145 

• 
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17  'VAR' 

Variables:  USEOl 

COH02  COH03  REL04  USE05 

MAN06 

QTYOV 

QLT08  REL09  QTYIO  RELll 

MAN12 

QTYIS 

QTY13R  QLT14  QLT15  MAN16 

Simple  Statistics 

Variable 

N 

Mean 

Std  Dev  Siam 

Minimum 

Maximum 

USE  01 

10 

0.30000 

1.25167  3.00000 

-1.00000 

2.00000 

COHO  2 

10 

0.20000 

1.13529  2.00000 

-1.00000 

2.00000 

COHO  3 

10 

0.50000 

1.17851  5.00000 

-2.00000 

2.00000 

REL04 

10 

0 

1.41421  0 

-2.00000 

2,00000 

USE  05 

10 

-0.40000 

1.17379  -4.00000 

-2.00000 

2.00000 

MAN06 

10 

0.30000 

1.05935  3.00000 

-1.00000 

2.00000 

QTY07 

10 

0.50000 

0.97183  5.00000 

-1.00000 

2.00000 

QLT08 

10 

0 

0.47140  0 

-1.00000 

1.00000 

REL09 

10 

-0.20000 

1.22927  -2.00000 

-2.00000 

2.00000 

QTYIO 

10 

0.10000 

1.37032  1.00000 

-1.00000 

2.00000 

RELll 

10 

-0.10000 

1.10050  -1.00000 

-1.00000 

2.00000 

MAN12 

10 

0.20000 

1.22927  2.00000 

-2.00000 

2,00000 

QTY13 

10 

-0.80000 

0.63246  -8.00000 

-2.00000 

0 

QTY13R 

10 

0.80000 

0.63246  8.00000 

0 

2.00000 

QLT14 

10 

0.20000 

0.42164  2.00000 

0 

1.00000 

QLT15 

10 

0.50000 

0.52705  5.00000 

0 

1.00000 

MAN16 

10 

0.10000 

1.28668  1.00000 

-2.00000 

2.00000 

Cronbach  Coefficient  Alpha 

for  RAW  variables  :  0. 

842672 

for  STANDJ^IZED  variables:  0. 

813128 

Raw  Variables 

Std.  Variables 

Deleted 

Correlation 

Correlation 

Variable 

with  Total 

Alpha  with  Total 

Alpha 

USEOl 

0.439397 

0.835400 

0.456969 

0.800474 

COHO  2 

0.743123 

0.817569 

0.773888 

0.779802 

COHOS 

0.468389 

0.833421 

0.419257 

0.802836 

REL04 

0.501184 

0.832295 

0.479824 

0.799033 

USE05 

0.945647 

0.804317 

0.918695 

0.769852 

'  MAN06 

0.656323 

0.823408 

0.573754 

0.793029 

QTY07 

0.499366 

0.832061 

0.436845 

0.801737 

QLT08 

0.174175 

0.844246 

0.245249 

0.813471 

REL09 

0.933008 

0.803855 

0.905240 

0.770790 

QTYIO 

-0.397043 

0.885726 

-0.348876 

0.846672 

RELll 

0.757314 

0.817241 

0.746795 

0.781627 

MAN12 

0.803399 

0.812482 

0.767451 

0.780236 

QTY13 

-0.127751 

0.853333 

■0.283526 

0.843246 

QTY13R 

-0.003680 

0.849797 

0.056941 

0.824504 

QLT14 

0.055283 

0.846553 

0.117262 

0.821023 

QLT15 

0-099871 

0.846136 

0.165390 

0.818209 

MAN16 

0.789807 

0.812621 

0.739893 

0.782091 
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5  'VAR*  Variables:  P65 

P66 

P67 

P68 

P69 

Variable 

N 

Simple 

Mean 

!  Statistics 
Std  Dev 

Sum 

Minimum 

Maximum 

P65 

10 

-0.60000 

0.84327 

-6.00000 

-2.00000 

1.00000 

P66 

10 

0.60000 

1.17379 

6.00000 

-1.00000 

2.00000 

P67 

10 

0.30000 

1.05935 

3.00000 

-2.00000 

2.00000 

P68 

10 

1.00000 

0.94281 

10.00000 

-1.00000 

2.00000 

P69 

10 

0.90000 

0.87560 

9.00000 

0 

2.00000 

Cronbach  Coefficient  Alpha 
for  RAW  variables  :  0* 331376 

for  STANDARDIZED  variables:  0.404816 


Raw  Variables  Std.  Variables 

Deleted  Correlation  Correlation 

Variable  with  Total  Alpha  with  Total  Alpha 


P65 

P66 

P67 

P68 

P69 


0.222439 

-0.101999 

-0.073546 

0.337100 

0.692086 


0.239766 

0.534351 

0.483932 

0.127946 

-0.199377 


0.208951 

-0.060030 

0.018556 

0.313127 

0.679348 


0.349644 

0.537994 

0.486998 

0.265634 

-0.085043 
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Version  D  -  Non-Cohesive  Syntax  Cues 


.SAS  Pro2ram  File 

TITLE  'Version  D  -  Non-Cohesive  Syntax  Cues'; 

OPTIONS  LINESIZE=80; 

INPUT  SUBJ  1-2  GRP  3  EIS  $  4-7  SEC  $  8-9 

VER  $  10  CUES  $  11-14  TIME  15-18  SCORE  19-20 
USEOl  21-22  COH02  23-24  COH03  25-26  REL04  27-28 

USE05  29-30  MAN06  31-32  QTY07  33-34  QLT08  35-36 

REL09  37-38  QTYIO  39-40  RELll  41-42  MAN12  43-44 

QTY13  45-46  QLT14  47-48  QLT15  49-50  MAN16  51-52 

P65  53-54  P66  55-56  P67  57-58  P68  59-60 


P69  61-62  D70 

D73  66; 

QTY13R  =  -1*(QTY13); 

CARDS; 

IIBAFBEEDNOSY  554  6  1  1  1  1  1  1 
22BAFBPNDNOSY  3 64  4211121 
33DRP  EEDNOSY  852  1  1  1.  1  1  1  1 
44DRP  PNDNOSY  846  0-1-2  O-l-l-l 
91BAFBEEDNOSY  720  6011101 
102BAFBPNDNOSY  845  8111212 
113DRP  EEDNOSY  996  O-l-l-l  1-1-1 
124DRP  PNDNOSY1242  0122111 
171BAFBEEDNOSY  532  3111111 
182BAFBPNDNOSY  450  9121111 
204DRP  PNDNOSY1042  2-1-1  0  0-1  0 
262BAFBPNDNOSY  43810  111  0-1-1 
273DRP  EEDNOSY  668  0  l-l-l-l-l-l 
284DRP  PNDNOSY  919  5-1-1-1-1-2-1 
RUN; 

PROC  CORR  ALPHA; 

VAR  COH02  COHOS; 

RUN; 

PROC  FREQ; 

TABLES  COH02  COHOS; 

RUN; 

PROC  CORR  ALPHA; 

VAR  QLT08  QLT14  QLT15; 

RUN; 

PROC  FREQ; 

TABLES  QLT08  QLT14  QLT15; 

RUN; 

PROC  CORR  ALPHA; 

VAR  MAN06  MAN12  MAN16; 

RUN; 

PROC  FREQ; 

TABLES  MAN06  MAN12  MAN16; 

RUN; 

PROC  CORR  ALPHA; 

VAR  REL04  REL09  RELll; 

RUN; 

PROC  FREQ; 

TABLES  REL04  REL09  RELll; 

RUN; 


63  D71  64  D72  65 


1  0  1-1  1  1-1  0110  1-1  0  12521 
10101  1-1  0  0  1-1  oil  03523 
10111  1-1  0-1  11111  14223 
0-1-2  l-l-l-l  0-1-2  1110  02521 
001101000  1-2-1-2-1-23513 
0  0  1-1  1  1-1  0110101  14524 
101  1-1  0-1  01-10202  22423 
11101  1-1  1111212  23521 
1  0  1-1  1  1-1  1  1  1-1-1  2  2  12311 
1  O-l-l-l  1-1  0-1  1-2  2-2  2  01521 
1  1-1  2  0-1-1  1  1-1  1010  12523 
1  0-1  0  0-1  0  0  0-1  0000  03513 
0  O-l-l-l-l-l  0  O-l-l-l  1  1  13521 
■1  0-1  1-1-1  1  0  0-1-1  111  13511 


PROC  CORK  ALPHA; 

VAR  QTY07  QTYIO  QTY13; 

RUN; 

PROC  FREQ; 

TABLES  QTY07  QTYIO  QTY13; 

RUN; 

PROC  CORR  ALPHA; 

VAR  QTYIO  QTY13R; 

RUN; 

PROC  FREQ; 

TABLES  QTYIO  QTY13R; 

RUN; 

PROC  CORR  ALPHA; 

VAR  USEOl  USE05; 

RUN; 

PROC  FREQ; 

TABLES  USEOl  USE05; 

RUN; 

PROC  CORR  ALPHA; 

VAR  USEOl  COH02  COH03  REL04  USE05  MAN06  QTY07  QLT08  REL09  QTYIO 
RELll  MAN12  QTY13  QTY13R  QLT14  QLT15  MAN16; 

RUN; 

PROC  FREQ; 

TABLES  USEOl  COH02  COH03  REL04  USE05  MAN06  QTY07  QLT08  REL09  QTYIO 
RELll  MAN12  QTY13  QTY13R  QLT14  QLT15  MAN16; 

RUN; 

PROC  CORR  ALPHA; 

VAR  P65  P66  P67  P68  P69; 

RUN; 

PROC  FREQ; 

TABLES  P65  P66  P67  P68  P69; 

RUN; 
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LIS  File  fResults^ 


Version  D  -  Non-Cohesive  Syntax  Cues 

2  'VAR'  Variables:  COH02  COH03 
Cronbach  Coefficient  Alpha 
for  RAW  variables  :  0.904306 

for  STANDARDIZED  variables:  0.927218 

Raw  Variables  Std.  Variables 

Deleted  Correlation  Correlation 

Variable  with  Total  Alpha  with  Total  Alpha 


COH02  0.864312  .  0.864312 

COH03  0.864312  .  0.864312 


3  'VAR'  Variables:  QLT08  QLT14  QLT15 
Cronbach  Coefficient  Alpha 
for  RAW  variables  :  0.755844 

for  STANDARDIZED  variables:  0.812733 

Raw  Variables  Std.  Variables 

Deleted  Correlation  Correlation 

Variable  with  Total  Alpha  with  Total  Alpha 


QLT08  0.680082  0.611111  0.710182  0.693737 
QLT14  0.657226  0.661017  0.684770  0.720485 
QLT15  0.597763  0.806452  0.596983  0.809282 


3  'VAR'  Variables:  MAN06  MAN12  MAN16 
Cronbach  Coefficient  Alpha 
for  RAW  variables  :  0.972096 

for  STANDARDIZED  variables:  0.973948 

Raw  Variables  Std.  Variables 

Deleted  Correlation  Correlation 

Variable  with  Total  Alpha  with  Total  Alpha 


MAN06  0.924059  0.969849  0.922870  0.976012 
MAN12  0.942743  0.961494  0.941815  0.962556 
MAN16  0.965231  0.943135  0.965885  0.945247 


3  'VAR'  Variables:  REI.04  REL09  RELll 
Cronbach  Coefficient  Alpha 
for  RAW  variables  :  0.892726 

for  STANDARDIZED  variables:  0.895677 

Raw  Variables  Std.  Variables 

Deleted  Correlation  Correlation 

Variable  with  Total  Alpha  with  Total  Alpha 


REL04  0.811111  0.832335  0.802770  0.843899 
REL09  0.851298  0.801527  0.850654  0.801683 
RELll  0.735153  0.894444  0.732407  0.903636 
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3  'VAR'  Variables:  QTYO?  QTYIO  QTY13 
Cronbach  Coefficient  Alpha 


for  RAW  variables  : 

-1.65957 

for  STANDARDIZED  variables: 

-1.56938 

Raw  Variables 

Std. 

Variables 

Deleted 

Correlation 

Correlation 

Variable 

with  Total  Alpha 

with  Total 

Alpha 

QTY07 

-0.653390  0.414634 

-0.660803 

0.458645 

QTYIO 

-0.382143  -1.923077 

-0.252097 

-2.166072 

QTY13 

-0.157378  -2.315789 

-0.233002 

-2.391562 

2  'VAR'  Variables:  QTYIO 

QTY13R 

Cronbach  Coefficient  Alpha 

for  RAW  variables  : 

-.708333 

for  STANDARDIZED  variables: 

-.847216 

Raw  Variables 

std. 

Variables 

Deleted 

Correlation 

Correlation 

Variable 

with  Total  Alpha 

with  Total 

Alpha 

QTYIO 

-0.297560 

-0.297560 

, 

QTY13R 

-0.297560 

-0.297560 

• 

2  'VAR'  Variables:  USEOl 

USE05 

Cronbach  Coefficient  Alpha 

for  RAW  variables  : 

0.874534 

for  STANDARDIZED  variables: 

0.881755 

Raw  Variables 

std. 

Variables 

Deleted 

Correlation 

Correlation 

Variable 

with  Total  Alpha 

with  Total 

Alpha 

USEOl 

0.788517 

0.788517 

USE05 

0.788517 

0.788517 

• 
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17  *VAR* 

Variables: 

USEOl 

COHO  2 

COHO 3  REL04 

USE05 

MAN06 

QTY07 

QLT08 

REL09  QTYIO 

RELll 

MAN12 

QTY13 

QTY13R 

QLT14  QLT15 

MAN16 

Simple  Statistics 

Variable 

N 

Mean 

Std  Dev 

Sum 

Minimum 

Maximum 

USEOl 

14 

0.42857 

1.01635 

6.00000 

■1.00000 

2.00000 

COH02 

14 

0,35714 

1.27745 

5.00000 

•2.00000 

2.00000 

COH03 

14 

0.50000 

0.94054 

7.00000 

•1.00000 

2.00000 

REL04 

14 

0,50000 

0.94054 

7.00000 

■1.00000 

2.00000 

USE05 

14 

0.07143 

1.20667 

1.00000 

•2.00000 

2.00000 

MAN06 

14 

0,28571 

1.06904 

4.00000 

■1.00000 

2.00000 

QTY07 

14 

0.14286 

0.86444 

2.00000 

■1.00000 

1.00000 

QLT08 

14 

0,07143 

0.47463 

1.00000 

■1.00000 

1.00000 

REL09 

14 

0.07143 

1.14114 

1.00000 

•2.00000 

1.00000 

QTYIO 

14 

0.14286 

1.02711 

2.00000 

■1.00000 

2.00000 

RELll 

14 

0.07143 

0.91687 

1.00000 

■1.00000 

1.00000 

MAN12 

14 

0,21429 

0.97496 

3.00000 

■1.00000 

1.00000 

QTY13 

14 

-0.71429 

0.61125 

-10.00000 

■1.00000 

1.00000 

QTY13R 

14 

0.71429 

0.61125 

10.00000 

■1.00000 

1.00000 

QLT14 

14 

0.21429 

0.42582 

3.00000 

0 

1.00000 

QLT15 

14 

0.21429 

0.80178 

3.00000 

•1.00000 

1.00000 

MAN16 

14 

0.07143 

1.14114 

1.00000 

■2.00000 

1.00000 

Cronbach  Coefficient  Alpha 
for  RAW  variables  :  0.902490 

for  STANDARDIZED  variables:  0.883027 


Raw  Variables  Std-  Variables 


Deleted 

Variable 

Correlation 
with  Total 

Alpha 

Correlation 
with  Total 

Alpha 

USEOl 

0.637546 

0.894467 

0.598213 

0.873591 

COH02 

0.824529 

0.886674 

0.809452 

0.865265 

COHO  3 

0.807726 

0.888981 

0.795810 

0.865813 

REL04 

0.846303 

0.887684 

0.821906 

0.864763 

USE05 

0.893675 

0.883755 

0.862383 

0.863125 

MAN06 

0.899474 

0.884504 

0.881163 

0.862361 

QTY07 

0.688905 

0.893324 

0.645110 

0.871772 

QLT08 

0.341973 

0.902835 

0.385083 

0.881652 

REL09 

0.769587 

0.889268 

0.764971 

0.867046 

QTYIO 

-0.469787 

0.929677 

-0.437340 

0.909752 

RELll 

0.835402 

0.888290 

0.843476 

0.863892 

MAN12 

0.906996 

0.885206 

0.865451 

0.863001 

QTY13 

-0.433683 

0.917576 

-0.472009 

0.910837 

QTY13R 

0.329337 

0.902956 

0.303590 

0.884647 

QLT14 

0.248269 

0.904275 

0.296476 

0.884906 

QLT15 

0.221396 

0.906287 

0.275371 

0.885673 

MAN16 

0.935599 

0.882397 

0.907057 

0.861302 
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5  'VAR'  Variables:  P65 

P66 

P67 

P68 

P69 

Simple 

!  Statistics 

Variable 

N 

Mean 

Std  Dev 

Sum 

Minimum 

Maximum 

P65 

14 

-0.28571 

1.06904 

-4.00000 

-2.00000 

1.00000 

P66 

14 

0.57143 

1.08941 

8.00000 

-1.00000 

2.00000 

P67 

14 

0.28571 

1.20439 

4.00000 

-2.00000 

2.00000 

P68 

14 

0.85714 

0.94926 

12.00000 

-1.00000 

2.00000 

P69 

14 

0.64286 

1.00821 

9.00000 

-2.00000 

2.00000 

Cronbach  Coefficient  Alpha 
for  RAW  variables  :  0.726686 

for  STANDARDIZED  variables:  0.736415 


Raw  Variables  Std.  Variables 

Deleted  Correlation  Correlation 

Variable  with  Total  Alpha  with  Total  Alpha 


P65 

0.481386 

0.681988 

0.456989 

0.706181 

P66 

0.333016 

0.738729 

0.364916 

0.739556 

P67 

0.371757 

0.731660 

0.380608 

0.733989 

P68 

0.475252 

0.685587 

0.478756 

0.698038 

P69 

0.850661 

0.533333 

0.856050 

0.540666 
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Version  E  -  Non~Cohesive  Visual  Cues,  Cohesive  Linguistic  Cues 

♦SAS  Program  Ffle 


TITLE  'Version  E  -  Non-Cohesive  Visual  Cues,  Cohesive  Linguistic  Cues’ 
OPTIONS  LINESIZE=80; 

DATA  dataset ; 

INPUT  SUBJ  1-2  GRP  3  EIS  $  4-7  SEC  $  8-9 

VER  $  10  CUES  $  11-14  TIME  15-18  SCORE  19-20 
USEOl  21-22  COH02  23-24  COH03  25-26  REL04  27-28 

USE05  29-30  MAN06  31-32  QTY07  33-34  QLT08  35-36 

REL09  37-38  QTYIO  39-40  RELll  41-42  MAN12  43-44 

QTY13  45-46  QLT14  47-48  QLT15  49-50  MAN16  51-52 

P65  53-54  P66  55-56  P67  57-58  P68  59-60 

P69  61-62  D70  63  D71  64  D72  65 

D73  66; 

QTY13R  =  -1* (QTY13) ; 

CARDS; 

22BAFBEEELING  414  7  1  1  1  1  2  2  0  0  1-1  1  1  0  0  0  1-1  0  1  1  03523 
33BAFBPNELING  789  711110100  1-1  0021111111  14223 
44DRP  EEELING1061  8-1-1  1  0-1  2-1  0-1  1-1-1  011-11110  02521 
55DRP  PNELING  945  610211110  1-1  01-10011011  02521 
102BAFBEEELING  908  3  1  1  1  2  2  1  0  0  2-1  2  1-1  0  1  2  0  1  0  1  14524 

113BAFBPNELING  891  6  1-1-1-2-1-1-1  0-2  1-2-1-2  0-1-1  0202  22423 

124DRP  EEELING1347  2111111121-110-11111212  23521 
135DRP  PNELING1286  5  0-1  0-1-1-1-1-1-2  0-2  0  l-l-l-l-l  011  12521 
182BAFBEEELING  426  111111110  1-1-1  1-1  0-1  1-2  2-2  2  01521 
204DRP  EEELING  677  1  1  0  1-1  0-1  1  1-1  2-1-1-2  11-11010  12523 

215DRP  PNELING1105  200  1-1-1  0-1  0-1  0-1  0-1  0  0-1  0-2-2-2-22513 

262BAFBEEELING  613  3-2-2-1  0-2-1  00-1000001-10000  03513 
273BAFBPNELING  696  6  1  1  1  1  1  1  0  0  1-1  1  1-1  0  0  1-1-1  1  1  13521 
284DRP  EEELING  539  O-l-l-l-l-l-l-l  0-1  l-l-l-l  0  1-1-1  111  13511 
295DRP  PNELING1447  5-1-1  l-l-l-l  0  O-l-l-l-l  1  0  0-1  1111  13215 


RUN; 

PROC  CORR  ALPHA; 

VAR  COH02  COH03; 

RUN; 

PROC  FREQ; 

TABLES  COH02  COH03; 

RUN; 

PROC  CORR  ALPHA; 

VAR  QLT08  QLT14  QLT15; 
RUN; 

PROC  FREQ; 

TABLES  QLT08  QLT14  QLT15; 
RUN; 

PROC  CORR  ALPHA; 

VAR  MAN06  MAN12  MAN16; 
RUN; 

PROC  FREQ; 

TABLES  MAN06  MAN12  MAN16; 
RUN; 

PROC  CORR  ALPHA; 

VAR  REL04  REL09  RELll; 
RUN; 

PROC  FREQ; 

TABLES  REL04  REL09  RELll; 


RUN; 

PROC  CORR  ALPHA; 

YAR  QTY07  QTYIO  QTY13; 

RUN; 

PROC  FREQ; 

TABLES  QTY07  QTYIO  QTY13; 

RUN; 

PROC  CORR  ALPHA; 

VAR  QTYIO  QTY13R; 

RUN; 

PROC  FREQ; 

TABLES  QTYIO  QTY13R; 

RUN; 

PROC  CORR  ALPHA; 

VAR  USEOl  USE05; 

RUN; 

PROC  FREQ; 

TABLES  USEOl  USE05; 

RUN; 

PROC  CORR  ALPHA; 

VAR  USEOl  COH02  COHOS  REL04  USE05  MAN06  QTY07  QLT08  REL09  QTYIO 
RELll  MAN12  QTY13  QTY13R  QLT14  QLT15  MAN16; 

RUN; 

PROC  FREQ; 

TABLES  USEOl  COH02  COHOS  REL04  USE05  MAN06  QTY07  QLT08  REL09  QTYIO 
RELll  MAN12  QTY13  QTY13R  QLT14  QLT15  MAN16; 

RUN; 

PROC  CORR  ALPHA; 

VAR  P65  P66  P67  P68  P69; 

RUN; 

PROC  FREQ; 

TABLES  P65  P66  P67  P68  P69; 

RUN; 
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.LIS  File  (Results^ 


Version  E  -  Non-Cohesive  Visual  Cues,  Cohesive  Linguistic  Cues 

2  'VAR'  Variables:  COH02  COH03 
Cronbach  Coefficient  Alpha 
for  RAW  variables  :  0.786585 

for  STANDARDIZED  variables:  0.790385 


Raw  Variables 

Std.  Variables 

Deleted 

Correlation 

Correlation 

Variable 

with  Total  Alpha 

with  Total  Alpha 

COH02 

0.653418 

0.653418 

COH03 

0.653418 

0.653418 

3  'VAR'  Variables:  QLT08 

QLT14  QLT15 

Cronbach  Coefficient  Alpha 

for  RAW  variables 

:  0.812500 

for  STANDARDIZED  variables 

0.832555 

Raw  Variables 

std. 

Variables 

Deleted 

Correlation 

Correlation 

Variable 

with  Total  Alpha 

with  Total 

Alpha 

QLT08 

0.633064  0.773006 

0.657261 

0.802330 

QLT14 

0.800095  0.641975 

0.804789 

0.652652 

QLT15 

0.616111  0.830769 

0.622948 

0.835013 

3  'VAR'  Variables:  MAN06 

MAN12  MAN16 

Cronbach  Coefficient  Alpha 

for  RAW  variables 

:  0.865385 

for  STANDARDIZED  variables 

:  0.875952 

Raw  Variables 

Std.  ' 

Variables 

Deleted 

Correlation 

Correlation 

Variable 

with  Total  Alpha 

with  Total 

Alpha 

MAN06 

0.682528  0.880000 

0.673856 

0.901033 

MAN12 

0.757379  0.826271 

0.759022 

0.826426 

MAN16 

0.843899  0.712166 

0.856986 

0.735299 

3  *VAR*  Variables:  REL04 

REL09  RELll 

Cronbach  Coefficient  Alpha 

for  RAW  variables 

:  0.958042 

for  STANDARDIZED  variables 

:  0.959051 

Raw  Variables 

Std.  Variables 

Deleted 

Correlation 

Correlation 

Variable 

with  Total  Alpha 

with  Total 

Alpha 

REL04 

0.938561  0.919732 

0.936103 

0.922339 

REL09 

0.937519  0.921053 

0.937775 

0.921080 

RELll 

0.865753  0.971061 

0.865727 

0.974243 
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3  'VAR'  Variables:  QTY07  QTYIO  QTY13 
Cronbach  Coefficient  Alpha 
for  RAW  variables  :  -2.62500 

for  STANDARDIZED  variables:  -2.71969 


Raw  Variables 

Std. 

Variables 

Deleted 

Correlation 

Correlation 

Variable 

with  Total  Alpha 

with  Total 

Alpha 

QTY07 

-0.507281  -1.324138 

-0.517161 

-1.336119 

QTYIO 

-0.599186  -0.453988 

-0.607851 

-0.487496 

QTY13 

-0.544862  -1.125000 

-0.531515 

-1.176148 

: 

1 

1 

1 

1 

2  *VAR*  Variables:  QTYIO 

QTY13R 

Cronbach  Coefficient  Alpha 

for  RAW  variables  : 

0.569733 

for  STANDARDIZED  variables: 

0.571940 

Raw  Variables 

std. 

Variables 

Deleted 

Correlation 

Correlation 

Variable 

with  Total  Alpha 

with  Total 

Alpha 

QTYIO 

0.400501 

0.400501 

. 

QTY13R 

0.400501 

0.400501 

1 

2  *VAR*  Variables:  USEOl 

USE05 

Cronbach  Coefficient  Alpha 

for  RAW  variables  : 

0.862423 

for  STANDARDIZED  variables: 

0.871582 

Raw  Variables 

std. 

Variables 

Deleted 

Correlation 

Correlation 

Variable 

with  Total  Alpha 

with  Total 

Alpha 

USEOl 

0.772393 

0.772393 

. 

USE05 

0.772393 

0.772393 

- 
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17  'VAR' 

Variables: 

USEOl 

COH02  COH03  REL04 

USE05 

MAN06 

QTY07 

QLT08  REL09  QTYIO 

RELll 

MAN12 

QTY13 

QTY13R  QLT14  QLT15 

MAN16 

Simple  Statistics 

Variable 

N 

Mean 

Std  Dev  Sum 

Minimvim 

Maximum 

USEOl 

15 

0.26667 

1.03280  4.00000 

-2.00000 

1.00000 

COHO  2 

15 

-0.06667 

1.03280  -1.00000 

-2.00000 

1.00000 

COHO  3 

15 

0.60000 

0.91026  9.00000 

-1.00000 

2.00000 

REDO  4 

15 

0,06667 

1.16292  1.00000 

-2.00000 

2.00000 

USE05 

15 

0 

1.25357  0 

-2.00000 

2.00000 

MAN06 

15 

0.26667 

1.16292  4.00000 

-1.00000 

2.00000 

QTY07 

15 

-0.06667 

0.79881  -1.00000 

-1.00000 

1.00000 

QLT08 

15 

0.13333 

0.63994  2.00000 

-1.00000 

2.00000 

REL09 

15 

-0.13333 

1,30201  -2.00000 

-2.00000 

2.00000 

QTYIO 

15 

-0.20000 

1.01419  -3.00000 

-1.00000 

2.00000 

RELll 

15 

-0.33333 

1.17514  -5.00000 

-2.00000 

2.00000 

MnN12 

15 

0 

0.84515  0 

-1.00000 

1.00000 

QTY13 

15 

-0.46667 

1.12546  -7.00000 

-2.00000 

2.00000 

QTY13R 

15 

0.46667 

1,12546  7.00000 

-2.00000 

2.00000 

QLT14 

15 

0.20000 

0.56061  3.00000 

-1.00000 

1.00000 

QLT15 

15 

0.26667 

0.79881  4.00000 

-1.00000 

1.00000 

MAN16 

15 

0 

1.13389  0 

-1.00000 

2.00000 

Cronbach  Coefficient  Alpha 
for  RAW  variables  ;  0.867553 

for  STANDARDIZED  variables:  0.863011 


Deleted 

Variable 


USEOl 

COH02 

COHO  3 

REL04 

USE05 

MAN06 

QTY07 

QLT08 

REL09 

QTYIO 

RELll 

MAN12 

QTY13 

QTY13R 

QLT14 

QLT15 

MAN16 


Raw  Variables  Std.  Variables 

Correlation  Correlation 

with  Total  Alpha  with  Total  Alpha 


0.608907 

0.855179 

0.864639 

0.843523 

0.647659 

0.854448 

0.868629 

0.841305 

0.886412 

0.839111 

0.724208 

0.848864 

0.611949 

0.856857 

0.386562 

0.864740 

0.934791 

0.835599 

-0.627933 

0.902913 

0.780875 

0.845810 

0.644922 

0.855211 

-0.225362 

0.891714 

0.001726 

0.882354 

0.350847 

0.865918 

0.213314 

0.870001 

0.897895 

0.840203 

0.591953 

0.850687 

0.844772 

0.838868 

0.643191 

0.848341 

0.838553 

0.839166 

0.853063 

0.838470 

0.705851 

0.845437 

0.632718 

0,848822 

0.434699 

0.857737 

0.909516 

0.835743 

-0.584624 

0.898212 

0.768042 

0.842519 

0.561387 

0.852075 

-0.237200 

0.885390 

0.031974 

0.874779 

0.394190 

0.859517 

0.249427 

0.865755 

0.855237 

0.838365 
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5 

*VAR*  Variables:  P65 

P66  P67 

P68 

P69 

Simple 

1  Statistics 

Variable 

N 

Mean 

Std  Dev  Sum 

Minimum 

Maximum 

P65 

15 

0 

1.00000  0 

-2.00000 

1.00000 

P66 

15 

0.53333 

1.12546  8.00000 

-2.00000 

2.00000 

P67 

15 

0.40000 

1.05560  6.00000 

-2.00000 

1.00000 

P68 

15 

0.80000 

1.01419  12.00000 

-2.00000 

2.00000 

P69 

15 

0.60000 

0.98561  9.00000 

-2.00000 

2.00000 

Cronbach  Coefficient  Alpha 

for  RAW  variables  :  0. 

736364 

for  STANDARDIZED  variables:  0. 

736467 

Raw  Variables 

Std.  Variables 

Deleted 

Correlation 

Correlation 

Variable 

with  Total 

Alpha  with  Total 

Alpha 

P65 

0.127843 

0.813559 

0.125217 

0.818749 

P66 

0.568371 

0.662005 

0.573966 

0.661344 

P67 

0.458437 

0.705882 

0.472294 

0.700545 

P68 

0.592443 

0.654788 

0.579182 

0.659274 

P69 

0.823386 

0.563591 

0.820334 

0.557036 
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Version  F  -  Non-Cohesive  Linguistic  Cues,  Cohesive  Visual  Cues 

.SAS  Program  File 


TITLE  'Version  F  -  Non-Cohesive  Linguistic  Cues,  Cohesive  Visual  Cues'; 
OPTIONS  LINESIZE=80; 

DATA  dataset; 


INPUT  SUBJ 

1-2 

GRP 

3 

EIS  $ 

4-7 

SEC 

$ 

8-9 

VER 

$  10 

CUES  $  11- 

•14 

TIME  15-18 

SCORE 

19-20 

USEOl  21-22 

COH02  23- 

24 

COHO 3  25-26 

REL04 

27-28 

USE05  29-30 

MAN06  31- 

32 

QTY07  33-34 

QLT08 

35-36 

REL09  37-38 

QTYIO  39- 

40 

RELll  41-42 

MAN12 

43-44 

QTY13  45-46 

QLT14  47- 

48 

QLT15  49-50 

MAN16 

51-52 

P65 

53-54 

P66  55- 

•56 

P67  57-58 

P68 

59-60 

P69 

61-62 

D70 

63 

D71 

64 

D72 

65 

D73 

66; 

QTY13R  =  -1*(QTY13) ; 

CARDS; 

33BAFBEEFVIS 

363  1-1- 

1 

1111 

0 

0  0 

0  110 

0-1  1 

1 

1 

1 

1 

14223 

44BAFBPNFVIS 

626  1  0 

1 

1110 

1 

1  1 

0  10  0 

111 

1 

1 

1 

0 

02521 

55DRP  EEFVTS 

689  0-1- 

1 

1-1-1  1- 

-2 

0-1 

0-2-1-1 

0-1  0 

1 

0 

1 

1 

02521 

66DRP  PNFVIS 

908  0  1 

1 

1  0-1  0 

0 

0  1- 

■110  1 

0-1  1- 

■1 

1 

1- 

1 

13513 

113BAFBEEFVIS 

575  7  2 

1 

112  2 

1 

1  1- 

■1  1  1-1 

0  12 

0 

2 

0 

2 

22423 

124BAFBPNFVIS 

853  5  2 

2 

2  112 

2 

2  1- 

■112  2 

12  1 

1 

2 

1 

2 

23521 

135DRP  EEFVIS 

914  0-1- 

1- 

"I  0-1  1 

0 

0  0 

1  0  0-1 

0  10- 

•1 

0 

1 

1 

12521 

146DRP  PNFVTS 

1395  2  1 

1 

0  0  0  0 

1 

0  0“ 

-1  0  0-1 

0  0  0 

1 

0 

0 

0 

14214 

204BAFBPNFVIS 

798  9  2 

0 

1  0  0-1 

0 

1-1 

1  0  1-1 

1  1-1 

1 

0 

1 

0 

12523 

215DRP  EEFVIS 

1156  0-1- 

•1 

0-1  0  0 

0 

0-1 

l-l-l-l 

0  0  0 

0- 

-2- 

2- 

2- 

•22513 

226DRP  PNFVIS 

1022  5  1 

0 

1  0-1-1 

1 

0  0 

1  0-1-1 

0  0-1 

2 

0 

1 

1 

11115 

273BAFBEEFVIS 

674  7  1 

1 

1111 

0 

0  1 

0  110 

0  0  1- 

-1- 

-1 

1 

1 

13521 

284BAFBPNFVTS 

360  6  1 

1 

1111 

1 

0  1- 

-1  1  1-1 

0  11- 

■1 

1 

1 

1 

13511 

295DRP  EEFVIS 

1456  2-2- 

-1- 

-2-1-2-1 

0 

0-1 

1-1-1  1 

0  0-1 

1 

1 

1 

1 

13215 

306DRP  PNFVIS 

1077  2  0- 

-l-l-l-l 

-1 

0-1- 

1 

o 

0  0-1- 

-1- 

•1 

1 

13521 

RUN; 

PROC  CORR  ALPHA; 

VAR  COH02  COH03; 

RUN; 

PROC  FREQ; 

TABLES  COH02  COH03; 

RUN; 

PROC  CORR  ALPHA; 

VAR  QLT08  QLT14  QLT15; 
RUN; 

PROC  FREQ; 

TABLES  QLT08  QLT14  QLT15; 
RUN; 

PROC  CORR  ALPHA; 

VAR  MAN06  MAN12  MAN16; 
RUN; 

PROC  FREQ; 

TABLES  MAN06  MAN12  MAN16; 
RUN; 

PROC  CORR  ALPHA; 

VAR  REL04  REL09  RELll; 
RUN; 

PROC  FREQ; 

TABLES  REL04  REL09  RELll; 
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RUN; 

PROC  CORR  ALPHA; 

VAR  QTY07  QTYIO  QTY13; 

RUN; 

PROC  FREQ; 

TABLES  QTY07  QTYIO  QTY13; 

RUN; 

PROC  CORR  ALPHA; 

VAR  QTYIO  QTY13R; 

RUN; 

PROC  FREQ; 

TABLES  QTYIO  QTY13R; 

RUN; 

PROC  CORR  ALPHA; 

VAR  USEOl  USE05; 

RUN; 

PROC  FREQ; 

TABLES  USEOl  USE05; 

RUN; 

PROC  CORR  ALPHA; 

VAR  USEOl  COH02  COHOS  REL04  USE05  MAN06  QTY07  QLT08  REL09  QTYIO 
RELll  MAN12  QTY13  QTY13R  QLT14  QLT15  MAN16; 

RUN; 

PROC  FREQ; 

TABLES  USEOl  COH02  COHOS  REL04  USE05  MAN06  QTY07  QLT08  REL09  QTYIO 
RELll  MAN12  QTY13  QTY13R  QLT14  QLT15  MAN16; 

RUN; 

PROC  CORR  ALPHA; 

VAR  P65  P66  P67  P68  P69; 

RUN; 

PROC  FREQ; 

TABLES  P65  P66  P67  P68  P69; 

RUN; 
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LIS  File  rResults^ 


Version  F  -  Non-Cohesive  Linguistic  Cues,  Cohesive  Visual  Cues 

2  'VAR'  Variables:  COH02  COHOS 
Cronbach  Coefficient  Alpha 
for  RAW  variables  :  0.780362 

for  STANDARDIZED  variables:  0.780362 


Raw  Variables  Std.  Variables 

Deleted  Correlation  Correlation 

Variable  with  Total  Alpha  with  Total  Alpha 


COH02 

COHOS 

0.639831 

0.639831 

• 

0.639831 

0.639831 

• 

Deleted 

Variable 

3  'VAR'  Variables:  QLT08  QLT14  QLT15 

Cronbach  Coefficient  Alpha 
for  RAW  variables  :  0.839623 

for  STANDARDIZED  variables:  0.892762 

Raw  Variables  Std.  Variables 

Correlation  Correlation 

with  Total  Alpha  with  Total  Alpha 

QLT08 

QLT14 

QLT15 

0.844797 

0.761783 

0.723596 

0.648649 

0.821256 

0.873786 

0.876846 

0.783900 

0.712768 

0.769000 

0.851949 

0.912172 

3  'VAR'  Variables 

:  MAH06 

MAN12  MAN16 

Cronbach 

Coefficient  Alpha 

for  RAW  variables 

:  0.875826 

for  STANDARDIZED  variables 

:  0.876200 

Raw  Variables 

Std.  Variables 

Deleted 

Correlation 

Correlation 

Variable 

with  Total 

Alpha 

with  Total 

Alpha 

MAN06 

0.812190 

0.776758 

0.813748 

0.776972 

MAN12 

0.668663 

0.904393 

0.668544 

0.906185 

MAN16 

0.810307 

0.782123 

0.807439 

0.782846 

3  'VAR'  Variables 

:  REL04 

REL09  RELll 

Cronbach  Coefficient  Alpha 

for  RAW  variables 

:  0.958741 

for  STANDARDIZED  variables 

i:  0.961037 

Raw  Variables 

Std.  Variables 

Deleted 

Correlation 

Correlation 

Variable 

with  Total 

Alpha 

with  Total 

Alpha 

REL04 

0.922287 

0.936782 

0.920359 

0.940012 

REL09 

0.890307 

0.955490 

0.889236 

0.962849 

RELll 

0.940590 

0.923611 

0.941246 

0.924451 
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3  'VAR'  Variables:  QTY07  QTYIO  QTY13 
Cronbach  Coefficient  Alpha 


for  RAW  variables  : 

-.284483 

for  STANDARDIZED  variables: 

-.325491 

Raw  Variables 

Std. 

Variables 

Deleted 

Correlation 

Correlation 

Variable 

with  Total 

Alpha 

with  Total 

Alpha 

QTYO? 

0.022263 

-0.753846 

0.006023 

-0.757515 

QTYIO 

-0.320775 

0.383333 

-0.320775 

0.383333 

QTY13 

-0.012965 

-0.594203 

-0.030293 

-0.596926 

2  'VAR' 

Variables:  QTYIO 

QTY13R 

Cronbach  Coefficient  Alpha 

for  RAW  variables  : 

0.429825 

for  STANDARDIZED  variables: 

0.431015 

Raw  Variables 

std. 

Variables 

Deleted 

Correlation 

Correlation 

Variable 

with  Total 

Alpha 

with  Total 

Alpha 

QTYIO 

0.274709 

0.274709 

. 

QTY13R 

0.274709 

• 

0.274709 

• 

2  'VAR' 

'  Variables:  USEOl 

USE05 

Cronbach  Coefficient  Alpha 

for  RAW 

variables  : 

0.694737 

for  STANDARDIZED  variables: 

0.698548 

Raw  Variables 

Std. 

Variables 

Deleted 

Correlation 

Correlation 

Variable 

with  Total 

Alpha 

with  Total 

Alpha 

USKOl 

"0.536745 

0.536745 

. 

USE05 

0.536745 

1  •  , 

0.536745 

• 
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17  'VAR'  Variables:  USEOl 

COH02 

COH03 

REDO  4 

USE05 

MAN06 

QTY07 

QLT08 

REL09 

QTYIO 

RELll 

MAN12 

QTY13 

QTY13R 

QLT14 

QLT15 

MAN16 

Variable 

USEOl 

COHO  2 

COHO  3 

REL04 

USE05 

MAN06 

QTY07 

QLT08 

REL09 

QTYIO 

RELll 

MAN12 

QTY13 

QTY13R 

QLT14 

QLT15 

MANX  6 


Simple  Statistics 


N 

Mean 

Std  Dev 

Sum 

Minimum 

Maximum 

15 

0.33333 

1.29099 

5.00000 

-2.00000 

2.00000 

15 

0-13333 

1.06010 

2.00000 

-1.00000 

2.00000 

15 

0.46667 

1.06010 

7.00000 

-2.00000 

2.00000 

15 

0.13333 

0.83381 

2.00000 

-1.00000 

1.00000 

15 

0 

1.13389 

0 

-2.00000  ' 

2.00000 

15 

0.33333 

1.04654 

5.00000 

-1.00000 

2.00000 

15 

0.26667 

0.96115 

4.00000 

-2.00000 

2.00000 

15 

0.33333 

0.61721 

5.00000 

0 

2.00000 

15 

0.06667 

0.88372 

1.00000 

-1.00000 

1.00000 

15 

-0.06667 

0,88372 

-1.00000 

-1.00000 

1.00000 

15 

0.13333 

0.99043 

2.00000 

-2.00000 

1.00000 

15 

0.13333 

0,99043 

2.00000 

-1.00000 

2.00000 

15 

-0.26667 

0.96115 

-4.00000 

-1.00000 

2.00000 

15 

0-26667 

0.96115 

4.00000 

-2,00000 

1.00000 

15 

0.20000 

0.41404 

3.00000 

0 

1.00000 

15 

0.26667 

0.88372 

4.00000 

-1.00000 

2.00000 

15 

0.26667 

0.96115 

4.00000 

-1.00000 

2.00000 

Cronbach  Coefficient  Alpha 
for  RAW  variables  :  0.888665 

for  STANDARDIZED  variables:  0.889906 


Raw  Variables  Std.  Variables 


Deleted 

Variable 

Correlation 
with  Total 

Alpha 

Correlation 
with  Total 

Alpha 

USEOl 

0.667827 

0.877138 

0.669696 

0.878882 

COH02 

0.815475 

0.870870 

0.807458 

0.873745 

COHO  3 

0.692064 

0.876069 

0.684894 

0.878322 

REL04 

0.898163 

0.870751 

0.882961 

0.870872 

USE05 

0.808216  . 

0.870620 

0.797428 

0.874123 

MAN06 

0.574526 

0.880888 

0-556837 

0.882992 

QTY07 

0.707277 

0.875991 

0.716192 

0.877163 

QLT08 

0.666040 

0.880672 

0.694876 

0.877953 

REL09 

0.807121 

0.873113 

0.778217 

0.874847 

QTYIO 

-0.500703 

0.914103 

-0.473042 

0.916621 

RELll 

0.827648 

0.871064 

0.813305 

0.873524 

MAN12 

0.854236 

0.870003 

0.852863 

0.872022 

QTY13 

0.101125 

0.897556 

0.129807 

0.897763 

QTY13R 

-0.289861 

0.910164 

-0.314727 

0.911885 

QLT14 

0.462531 

0.886828 

0.484466 

0.885582 

QLT15 

0.552224 

0.881875 

0.587124 

0.881898 

MAN16 

0.698450 

0.876323 

0.666770 

0.878990 
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5  ’VAR*  Variables:  P65 

P66 

P67 

P68 

P69 

Variable 

N 

Simple 

Mean 

1  Statistics 
Std  Dev 

Sum 

Minimum 

Maximum 

P65 

15 

0.26667 

1.03280 

4.00000 

-1.00000 

2.00000 

P66 

15 

0.33333 

1.11270 

5.00000 

-2.00000 

2.00000 

P67 

15 

0.53333 

0.91548 

8.00000 

-2.00000 

1.00000 

P68 

15 

0.60000 

1.05560 

9.00000 

-2.00000 

2.00000 

P69 

15 

0.80000 

0.94112 

12.00000 

-2.00000 

2.00000 

Cronbach  Coefficient  Alpha 
for  RAW  variables  :  0.775650 

for  STANDARDIZED  variables:  0.778680 


Raw  Variables  Std.  Variables 

Deleted  Correlation  Correlation 

Variable  with  Total  Alpha  with  Total  Alpha 


P65 

P66 

P67 

P68 

P69 


0.162843 

0-708657 

0.614510 

0.640759 

0.696664 


0.854586 

0.673108 

0.715214 

0.701046 

0.686913 


0.159803 

0.713969 

0.614249 

0.647716 

0.692016 


0.856778 

0.681121 

0.716616 

0.704904 

0.689090 
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Version  G  -  All  Cues  Cohesive 


■SAS  Program  File 

TITLE  'Version  G  -  All  Cues  Cohesive'; 

OPTIONS  LINESIZE=80; 

DATA  dataset; 

INPUT  SUBJ  1-2  GRP  3  EIS  $  4-7  SEC  $  8-9 

VER  $  10  CUES  $  11-14  TIME  15-18  SCORE  19-20 
USEOl  21-22  COH02  23-24  COH03  25-26  REL04  27-28 

USE05  29-30  MAN06  31-32  QTY07  33-34  QLT08  35-36 

REL09  37-38  QTYIO  39-40  RELll  41-42  MAN12  43-44 

QTY13  45-46  QLT14  47-48  QLT15  49-50  MAN16  51-52 

P65  53-54  P66  55-56  P67  57-58  P68  59-60 


P69  61-62  D70 

D73  66; 

QTY13R  =  -1*{QTY13); 

CARDS; 

44BAFBEEGALL  503  1001001 
55BAFBPNGALL  407  6111111 
66DRP  EEGALL  955  O-l-l-l  1-2-1 
77DRP  PNGALL  1080  2211121 
124BAFBEEGALL  685  3122221 
135BAFBPNGALL  52610  111011 
146DRP  EEGALL  1098  3-1-1-1-2-1-1 
157DRP  PNGALL  755  3-1  0  1  0-1  0 
204BAFBEEGALL  1123  3-1-1-1-1-2  1 
215BAFBPNGALL  801  3111111 
226DRP  EEGALL  875  1-1-2  0-1-1  0 
237DRP  PNGALL  1429  2222222 
284BAFBEEGALL  466  7111111 
295BAFBPNGALL  651  6111111 
306DRP  EEGALL  719  1-1  01110 
317DRP  PNGALL  1024  0111012 
RUN; 

PROC  CORR  ALPHA; 

VAR  COH02  COH03; 

RUN; 

PROC  FREQ; 

TABLES  COH02  COH03; 

RUN; 

PROC  CORR  ALPHA; 

VAR  QLT08  QLT14  QLT15; 

RUN; 

PROC  FREQ; 

TABLES  QLT08  QLT14  QLT15; 

RUN; 

PROC  CORR  ALPHA; 

VAR  MAN06  MAN12  MAN16; 

RUN; 

PROC  FREQ; 

TABLES  MAN06  MAN12  MAN16; 

RUN; 

PROC  CORR  ALPHA; 

VAR  REL04  REL09  RELll; 

RUN; 

PROC  FREQ; 


63  D71  64  D72  65 


000001  0-1  001110  02521 
1  0  1-1  1  1-1  0011011  02521 
00101-100  1-1-1  1  1-1  13513 

1  0  1-1  1  1-1  0011011  12311 

2  1  1-1  1  2-1  1121212  23521 
0  0  0-1  0  0-1  0  1  1-1  oil  12521 
1-1-1  l-l-l-l-l  0-1  1000  14214 
100  1-1  0-1  0  0-1  1111  12521 
1  1-1  1  0-1-1  1  1-1  1010  12523 
1  0  1-1  1  1-1  oil  0-2-2-2-22513 

1  O-l-l-l-l  O-l-l-l  2011  11115 

2  2  2-1  2  2-1  2  2  2-1-1-1-1-11421 
0  0  1-1  1  1-1  0  1  1-1  111  13511 
0  0  1-1  1  1-1  0011111  13215 
000  1-1  0-1  0  0  O-l-l-l  1  13521 
•1  0  1-2  111001  2-2-1  2  12523 


121 


TABLES  REL04  REL09  RELll; 

RUN; 

PROC  CORR  ALPHA; 

VAR  QTY07  QTYIO  QTY13; 

RUN; 

PROC  FREQ; 

TABLES  QTY07  QTYIO  QTY13; 

RUN; 

PROC  CORR  ALPHA; 

VAR  QTYIO  QTY13R; 

RUN; 

PROC  FREQ; 

TABLES  QTYIO  QTY13R; 

RUN; 

PROC  CORR  ALPHA; 

VAR  USEOl  USE05; 

RUN; 

PROC  FREQ; 

TABLES  USEOl  USE05; 

RUN; 

PROC  CORR  ALPHA; 

VAR  USEOl  COH02  COH03  REL04  USE05  MAN06  QTY07  QLT08  REL09  QTYIO 
RELll  MAN12  QTY13  QTY13R  QLT14  QLT15  MAN16; 

RUN; 

PROC  FREQ; 

TABLES  USEOl  COH02  COH03  REL04  USE05  MAN06  QTY07  QLT08  REL09  QTYIO 
RELll  MAN12  QTY13  QTY13R  QLT14  QLT15  MAN16; 

RUN; 

PROC  CORR  ALPHA; 

VAR  P65  P66  P67  P68  P69; 

RUN; 

PROC  FREQ; 

TABLES  P65  P66  P67  P68  P69; 

RUN; 
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■LIS  File  (Results^ 


Version  G  -  All  Cues  Cohesive 

2  'VAR'  Variables:  COH02  COH03 
Cronbach  Coefficient  Alpha 
for  RAW  variables  :  0.910769 

for  STANDARDIZED  variables:  0.919916 


Deleted 

Variable 

Raw  Variables 
Correlation 
with  Total 

Alpha 

Std, 

Correlation 
with  Total 

Variables 

Alpha 

COH02 

COH03 

0.851707 

0.851707 

• 

0.851707 

0.851707 

. 

3  *  VAR ’  Variables 

:  QLT08 

QLT14  QLT15 

Cronbach  Coefficient  Alpha 

for  RAW  variables 

:  0.911672 

for  STANDARDIZED  variables:  0.912997 

Raw  Variables 

Std. 

Variables 

Deleted 

Correlation 

Correlation 

Variable 

with  Total 

Alpha 

with  Total 

Alpha 

QLT08 

0.827520 

0.875000 

0.823755 

0.875866 

QLT14 

0.918024 

0.789474 

0.921706 

0.792091 

QLT15 

0.741501 

0.939655 

0.736451 

0.946332 

3  'VAR'  Variables:  MAN06  MAN12  MAN16 
Cronbach  Coefficient  Alpha 
for  RAW  variables  :  0.926377 

for  STANDARDIZED  variables:  0.927762 

Raw  Variables  Std.  Variables • 

Deleted  Correlation  Correlation 

Variable  with  Total  Alpha  with  Total  Alpha 


MAN06  0.775845  0.954413  0.775738  0.955136 
MAN12  0.897169  0.853988  0.888592  0.865728 
MAN16  0.901661  0.853403  0.895428  0.860111 


3  'VAR'  Variables:  REL04  REL09  RELll 
Cronbach  Coefficient  Alpha 
for  RAW  variables  :  0.930978 

for  STANDARDIZED  variables:  0.936977 

Raw  Variables  Std.  Variables 

Deleted  Correlation  Correlation 

Variable  with  Total  Alpha  with  Total  Alpha 


REL04  0.824817  0.939355  0.827753  0.940598 
REL09  0.953726  0.835821  0.954196  0.840110 
RELll  0.821689  0.928251  0.830497  0.938498 
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3  'VAR'  Variables:  QTY07  QTYIO  QTY13 
Cronbach  Coefficient  Mpha 


Deleted 

Variable 

for  RAW  variables  : 

for  STANDARDIZED  variables: 

Raw  Variables 

Correlation 

with  Total  Alpha 

-2.25000 

-3.17229 

Std. 

Correlation 
with  Total 

Variables 

Alpha 

QTy07 

QTYIO 

QTY13 

-0.522233  -0.818182 
-0.470005  -1.424084 
-0.639398  -0.579387 

-0.597622 

-0.532412 

-0.637393 

-0.954528 

-1,777798 

-0.579891 

2  'VAR'  Variables:  QTYIO 

QTY13R 

Cronbach  Coefficient  Alpha 

for  RAW  variables  : 

0.450000 

for  STANDARDIZED  variables: 

0.488367 

Raw  Variables 

std. 

Variables 

Deleted 

Correlation 

Correlation 

Variable 

with  Total  Alpha 

with  Total 

Alpha 

QTYIO 

0.323073 

0-323073 

QTY13R 

0.323073 

0.323073 

• 

2  'VAR'  Variables:  USEOl 

USE05 

Cronbach  Coefficient  Alpha 

for  RAW  variables  : 

0.920658 

for  STANDARDIZED  variables: 

0.928494 

Raw  Variables 

std. 

Variables 

Deleted 

Correlation 

Correlation 

Variable 

with  Total  Alpha 

with  Total 

Alpha 

USEOl 

0.866531 

0.86653-1 

USE05 

0.866531 

0.866531 

s:===r===:=:==:=:5===== 
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17  'VAR' 


Variable 

USEOl 

COH02 

COHO  3 

REL04 

USE05 

MAN06 

QTY07 

QLT08 

REL09 

QTYIO 

RELll 

MAN12 

QTY13 

QTY13R 

QLT14 

QLT15 

MAN16 


Deleted 

Variable 


USEOl 

COH02 

COHO  3 

REL04 

USE05 

MAN06 

QTy07 

QLT08 

REL09 

QTYIO 

RELll 

MAN12 

QTY13 

QTY13R 

QLT14 

QLT15 

MAN16 


Dies: 

USEOl 

COHO  2 

COH03  REL04 

USE05 

MAN06 

QTY07 

QLT08 

REL09  QTYIO 

RELll 

MAN12 

QTY13 

QTY13R 

QLT14  QLT15 

MAN16 

Simple  Statistics 

N 

Mean 

Std  Dev 

Sum 

Minimum 

Maximum 

16 

0.31250 

1.13835 

5.00000 

-1.00000 

2.00000 

16 

0.37500 

1.14746 

6.00000 

-2.00000 

2.00000 

16 

0.68750 

0.94648 

11.00000 

-1.00000 

2.00000 

16 

0.43750 

1.09354 

7.00000 

-2.00000 

2.00000 

16 

0.37500 

1.36015 

6.00000 

-2.00000 

2.00000 

16 

0.68750 

0.87321 

11.00000 

-1.00000 

2.00000 

16 

0.25000 

1.00000 

4.00000 

-1.00000 

2.00000 

16 

0.18750 

0.65511 

3.00000 

-1.00000 

2.00000 

16 

0.43750 

0.89209 

7.00000 

-1.00000 

2.00000 

16 

-0.43750 

0.96393 

-7.00000 

-2.00000 

1.00000 

16 

0.37500 

0.95743 

6.00000 

-1.00000 

2.00000 

16 

0.43750 

1.03078 

7.00000 

-1.00000 

2.00000 

16 

-0.68750 

0.60208 

-11.00000 

-1.00000 

1.00000 

16 

0.68750 

0.60208 

11.00000 

-1.00000 

1.00000 

16 

0.06250 

0.77190 

1.00000 

-1.00000 

2.00000 

16 

0.43750 

0.72744 

7.00000 

-1.00000 

2.00000 

16 

0.37500 

1.08781 

6.00000 

-1.00000 

2.00000 

Cronbach  Coefficient  Alpha 
for  RAW  variables  :  0.920681 

for  STANDARDIZED  variables:  0.908993 


Raw  Variables  Std.  Variables 


Correlation 
with  Total 

Alpha 

Correlation 
with  Total 

Alpha 

0.840336 

0.908966 

0.816821 

0.896518 

0.930416 

0.905882 

0.911532 

0.893518 

0.784904 

0.911422 

0.754425 

0.898468 

0.823386 

0.909654 

0.822421 

0.896342 

0.804097 

0.910383 

0.773873 

0.897863 

0.720648 

0.913468 

0.713838 

0.899724 

0.739261 

’ 0.912486 

0.762727 

0.898210 

0.614828 

0.916915 

0.647246 

0.901766 

0.828337 

0.910618 

0.816377 

0.896532 

-0.621541 

0.946006 

-0.598505 

0.935718 

0.781153 

0.911470 

0.786793 

0.897459 

0.901642 

0.907533 

0.878084 

0.894583 

-0-317996 

0.932068 

-0-351818 

0.929604 

0.214285 

0.923801 

0.181318 

0.915386 

0.684556 

0.914844 

0.722578 

0.899454 

0.567765 

0.917492 

0.596666 

•  0.903301 

0.924975 

0.906415 

0.901041 

0.893853 

5  *VAR*  Variables:  P65 

P66 

P67 

P68 

P69 

Variable 

N 

Simple 

Mean 

:  Statistics 
Std  Dev 

Sum 

Minimum 

Maximum 

P65 

16 

0.43750 

1.09354 

7.00000 

-1.00000 

2.00000 

P66 

16 

0.06250 

1.12361 

1.00000 

-2.00000 

2.00000 

P67 

16 

0.37500 

1.02470 

6.00000 

-2.00000 

1.00000 

P68 

16 

0.50000 

1.09545 

8.00000 

-2.00000 

2.00000 

P69 

16 

0.62500 

0.95743 

10.00000 

-2.00000 

2.00000 

Cronbach  Coefficient  Alpha 
for  RAW  variables  :  0,791440 

for  STANDARDIZED  variables:  0.797907 

Raw  Variables  Std.  Variables 

Deleted  Correlation  Correlation 

Variable  with  Total  Alpha  with  Total  Alpha 


P65 

P66 

P67 

P68 

P69 


0-263667 

0.562296 

0.714852 

0.619987 

0.759881 


0.846445 

0.755280 

0.705546 

0.735360 

0.695995 


0.264401 

0.575511 

0.711657 

0.629972 

0.759325 


0.851357 

0.760606 

0.716103 

0.743167 

0.699796 


126 


Version  H -All Cues  Non-Cohesive 


.SAS  ProHram  File 


TITLE  'Version  H  “  No  Cohesive  Cues'; 
OPTIONS  LINESIZE=80; 

DATA  dataset; 


INPUT  SUBJ 

1-2 

GRP 

3 

EIS  $ 

4-7 

SEC 

$ 

8-9 

VER 

$  10 

CUES  $ 

11- 

14 

TIME  15-18 

SCORE  19-20 

USEOl 

21-22 

COH02 

23- 

24 

COH03  25-26 

REL04  27-28 

USE05 

29-30 

MAN06 

31- 

32 

QTY07  33-34 

QLT08  35-36 

REL09 

37-38 

QTYIO 

39- 

40 

RELll  41-42 

MAN12  43-44 

QTY13 

45-46 

QLT14 

47- 

•48 

QLT15  49-50 

MAN16  51-52 

P65 

53-54 

P66 

55- 

■56 

P67  57-58 

P68 

59-60 

P69 

61-62 

D70 

63 

D71 

64 

D72 

65 

D73 

66; 

QTY13R  =  -1* 

{QTY13) ; 

CARDS; 

55BAFBEEHNONE 

591  3-1  2 

1 

1-1  1  0 

0 

1 

0  110 

0  0  1 

1  0 

1  1 

02521 

66BAFBPNHNONE 

850  6  2  2 

2 

2  2  2  0 

0 

1 

0  12  0 

0  12- 

■1  1 

1-1 

13513 

77DRP  EEHNONE 

997  2  1-1 

0 

0  0  11 

0 

0 

1  0  0-1 

0  10 

1  0 

1  1 

12311 

88DRP  PNHNONElOlO  000 

0 

0  0  0  0 

0 

1 

1  0  0-2 

0  0  0- 

■1  0 

0-1 

04214 

135BAFBEEHNONE 

45410  1  1 

1 

1110 

0 

1- 

■2010 

0  0  1- 

■1  0 

1  1 

12521 

146BAFBPNHNONE 

399  5  0  0 

1 

10  0  0 

0 

0“ 

■1  0  0-1 

oil 

1  0 

0  0 

14214 

157DRP  EEHNONE 

667  3  0  0 

1 

1  0-1-1 

0 

0 

2-1-1-1 

0  0  0 

1  1 

1  1 

12521 

168DRP  PNHNONE 

569  2  1-1 

1 

1  0  ( 

3  0 

1 

0 

2-1  0-2 

0  0  0- 

'1  2 

0  1 

22521 

215BAFBEEHNONE 

670  7  1-1 

0- 

-1  1-1  0 

0- 

1- 

•l-l-l-l 

0  0-1 

0-2- 

2-2- 

22513 

226BAFBPNHNONE1163  301 

1 

0-1-: 

L  0 

0 

0 

0-1-1  0 

0  0-1 

2  0 

1  1 

11115 

237DRP  EEHNONE 

674  0  2  2 

2 

2  2  2  2 

2 

2- 

-1  2  2-1 

2  2  2- 

1-1- 

l-l- 

•11421 

248DRP  PNHNONE 

863  2-1-1 

0- 

-1-1  ( 

3-1- 

-1- 

2 

1  0-1-1 

0-2-1 

1-1- 

l-l 

03423 

295BAFBEEHNONE 

875  5  0  1 

1 

1  1  : 

L  0 

0 

1 

0  1  1-1 

0  0  1 

1  1 

1  1 

13215 

306BAFBPNHNONE 

911  3  0  0 

0 

0  0  0  0 

0 

0 

0  0  1-1 

0  0  0- 

‘1-1- 

•1  1 

13521 

3'17DRP  EEHNONE1122  0-1-1 

0 

0-1  : 

L-1 

0- 

1- 

-1-1-1  0 

0  0-2 

2-2- 

■1  2 

12523 

328DRP  PNHNONE 

872  3-1-1 

O' 

-1-1-: 

L-1 

1- 

2 

0-1-1  0 

0-1-1- 

-1-1 

2  2 

22521 

RUN; 

PROC  CORR  ALPHA; 

YAR  COH02  COH03; 

RUN; 

PROC  FREQ; 

TABLES  COH02  COH03; 

RUN; 

PROC  CORR  ALPHA; 

VAR  QLT08  QLT14  QLT15; 
RUN; 

PROC  FREQ; 

TABLES  QLT08  QLT14  QLT15; 
RUN; 

PROC  CORR  ALPHA; 

VAR  MAN06  MAN12  MAN16; 
RUN; 

PROC  FREQ; 

TABLES  MAN06  MAN12  MAN16; 
RUN; 

PROC  CORR  ALPHA; 

VAR  REL04  REL09  RELll; 
RUN; 

PROC  FREQ; 
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TABLES  REL04  REL09  RELll; 

RUN; 

PROC  GORR  ALPHA; 

VAR  QTY07  QTYIO  QTY13; 

RUN; 

PROC  FREQ; 

TABLES  QTY07  QTYIO  QTY13; 

RUN; 

PROC  CORR  ALPHA; 

VAR  QTYIO  QTY13R; 

RUN; 

PROC  FREQ; 

TABLES  QTYIO  QTY13R; 

RUN; 

PROC  CORR  ALPHA; 

VAR  USEOl  USE05; 

RUN; 

PROC  FREQ; 

TABLES  USEOl  USE05; 

RUN; 

PROC  CORR  /lLPHA; 

VAR  USEOl  COH02  COH03  REL04  USE05  MAN06  QTY07  QLT08  REL09  QTYIO 
RELll  MAN12  QTY13  QTY13R  QLT14  QLT15  MAN16; 

RUN; 

PROC  FREQ; 

TABLES  USEOl  COH02  COH03  REL04  USE05  MAN06  QTY07  QLT08  REL09  QTYIO 
RELll  MAN12  QTY13  QTY13R  QLT14  QLT15  MAN16; 

RUN; 

PROC  CORR  ALPHA; 

VAR  P65  P66  P67  P68  P69; 

RUN; 

PROC  FREQ; 

TABLES  P65  P66  P67  P68  P69; 

RUN) 
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US  FMe  rResults^ 


Version  H  -  No  Cohesive  Cues 


2  'VAR'  Variables:  COH02  COH03 
Cronbach  Coefficient  Alpha 
for  RAW  variables  ;  0.832461 

for  STANDARDIZED  variables;  0.892597 


Deleted 

Variable 

Raw  Variables 

Correlation 

with  Total  Alpha 

Std.  Variables 
Correlation 

with  Total  Alpha 

COH02 

COHO  3 

0.806027 

0.806027 

0-806027 

0.806027 

Deleted 

Variable 

3  »VAR*  Variables:  QLT08  QLT14  QLT15 

Cronbach  Coefficient  Alpha 
for  RAW  variables  :  0.783673 

for  STANDARDIZED  variables:  0.825238 

Raw  Variables  Std.  Variables 

Correlation  Correlation 

with  Total  Alpha  with  Total  Alpha 

QLT08 

QLT14 

QLT15 

0.678003 

0.727066 

0.585091 

0.652174 

0.674260 

0.831541 

0.717621 

0.744284 

0.588275 

0.721990 

0.694332 

0.849114 

3  'VAR'  Variables 

:  MAN06 

MAN12  MAN16 

Cronbach  Coefficient  Alpha 

for  RAW  variables 

:  0.915862 

for  STANDARDIZED  variables 

:  0.916198 

Raw  Variables 

Std.  Variables 

Deleted 

Correlation 

Correlation 

Variable 

with  Total 

Alpha 

with  Total 

Alpha 

MAN06 

0.747580 

0.943662 

0.749741 

0.944372 

MAN12 

0.939394 

0.785329 

0.936838 

0.788941 

MAN16 

0.817447 

0.892596 

0.813039 

0.893799 

3  *VAR*  Variables 

:  REL04 

REL09  RELll 

Cronbach  Coefficient  Alpha 

for  RAW  variables 

:  0.886097 

for  STANDARDIZED  variables 

i:  0.886904 

Raw  Variables 

Std.  Variables 

Deleted 

Correlation 

Correlation 

Variable 

with  Total 

Alpha 

with  Total 

Alpha 

REL04 

0.801924 

0.819444 

0.791933 

0.828183 

REDO  9 

0.855512 

0.771429 

0.854225 

0.771757 

RELll 

0.699896 

0.904167 

0.696950 

0.909967 
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3  'VAR'  Variables:  QTY07  QTYIO  QTY13 
Cronbach  Coefficient  Alpha 


for  RAW  variables  : 

-2.52404 

for  STANDARDIZED  variables: 

-2.91071 

Raw  Variables 

Std. 

Variables 

Deleted 

Correlation 

Correlation 

Variable 

with  Total  Alpha 

with  Total 

Alpha 

QTY07 

-0.427734  -1.860465 

-0.467516 

-2.374810 

QTYIO 

-0.598645  -0.562814 

-0.615889 

-0.568214 

QTY13 

-0.644658  -0.534091 

-0.614043 

-0.583285 

2  *VAR*  Variables:  QTYIO 

QTY13R 

Cronbach  Coefficient  Alpha 

for  RAW  variables  : 

0. 650407 

for  STANDARDIZED  variables: 

0.703687 

Raw  Variables 

Std. 

Variables 

Deleted 

Correlation 

Correlation 

Variable 

with  Total  Alpha 

with  Total 

Alpha 

QTYIO 

0.542837 

0.542837 

. 

QTY13R 

0.542837 

0.542837 

• 

2  ’VAR*  Variables:  USEOl 

USE05 

Cronbach  Coefficient  Alpha 

for  RAW  variables  : 

0.935065 

for  STANDARDIZED  variables: 

0.935213 

Raw  Variables 

std. 

Variables 

Deleted 

Correlation 

Correlation 

Variable 

with  Total  Alpha 

with  Total 

Alpha 

USEOl 

0.878310 

0.878310 

. 

USE05 

0.878310 

0.878310 

• 
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17  'VAR'  Variables:  USEOl 

QTY07 

QTY13 


COHO  2 
QLT08 
QTY13R 


COHO  3 
REL09 
QLT14 


REL04 

QTYIO 

QLT15 


USE  05 
RELll 
MAN16 


MAN06 

MAN12 


Variable 

USEOl 

COHO  2 

COHO  3 

REL04 

USE05 

MRNOe 

QTY07 

QLT08 

REL09 

QTYIO 

RELll 

MAN12 

QTY13 

QTY13R 

QLT14 

QLT15 

MAN16 


N 

Simple 

Mean 

!  Statistics 
Std  Dev 

Sum 

Minimum 

Maximum 

16 

0.25000 

1.00000 

4.00000 

-1.00000 

2.00000 

16 

0.18750 

1.16726 

3.00000 

-1.00000 

2.00000 

16 

0.68750 

0.70415 

11.00000 

0 

2.00000 

16 

0.43750 

0.96393 

7.00000 

-1.00000 

2.00000 

16 

0.12500 

1.02470 

2.00000 

-1.00000 

2.00000 

16 

0.31250 

1.01448 

5.00000 

-1.00000 

2.00000 

16 

-0.06250 

0.77190 

-1.00000 

-1.00000 

2.00000 

16 

0.18750 

0.65511 

3.00000 

-1.00000 

2.00000 

16 

0.06250 

1.12361 

1.00000 

-2.00000 

2.00000 

16 

0.06250 

1.12361 

1.00000 

-2.00000 

2.00000 

16 

-0.06250 

0.92871 

-1.00000 

-1.00000 

2.00000 

16 

0.12500 

1.08781 

2.00000 

-1.00000 

2.00000 

16 

-0.75000 

0,68313 

■12.00000 

-2.00000 

0 

16 

0.75000 

0.68313 

12.00000 

0 

2.00000 

16 

0.12500 

0.50000 

2.00000 

0 

2.00000 

16 

0.12500 

0.88506 

2.00000 

-2.00000 

2.00000 

16 

0.12500 

1.14746 

2.00000 

-2.00000 

2.00000 

Cronbach  Coefficient  Alpha 
for  RAW  variables  :  0*912566 

for  STANDARDIZED  variables:  0.909900 


Deleted 

Variable 


USEOl 

COH02 

COHO  3 

REL04 

USE05 

MAN06 

QTY07 

QLT08 

REL09 

QTYIO 

RELll 

MAN12 

QTY13 

QTY13R 

QLT14 

QLT15 

MAN16 


-Raw  Variables 


Correlation 
with  Total 

Alpha 

0.696443 

0.904227 

0.730887 

0.902956 

0.804744 

0.903343 

0.864765 

0.899065 

0.743682 

0.902637 

0.700557 

0.904069 

0.741625 

0.904140 

0.446562 

0.911262 

0.870270 

0.897828 

-0.269933 

0.935422 

0.785921 

0.901757 

0.880181 

0.897655 

-0.130418 

0.922790 

-0.002392 

0.920302 

0.603600 

0.909310 

0.757337 

0.902876 

0.897965 

0.896669 

Std.  Variables 


Correlation 
with  Total 

Alpha 

0.707716 

0.900971 

0.722515 

0.900519 

0.794890 

0.898289 

0.851512 

0.896525 

0.745915 

0.899801 

0.693239 

0.901413 

0.760180 

0.899362 

0.481072 

0.907751 

0.857143 

0.896349 

-0.270326 

0.928330 

0.775387 

0.898893 

0.863367 

0.896154 

-0.156877 

0.925403 

-0.025388 

0.921932 

0.631282 

0.903288 

0.772988 

0.898967 

0.880100 

0.895628 

131 


5  *VAR*  Variables:  P65 

P66 

P67 

P68 

P69 

Variable 

N 

Simple 

Mean 

i  Statistics 
Std  Dev 

Sum 

Minimum 

Maximum 

P65 

16 

0.18750 

1.16726 

3.00000 

-1.00000 

2.00000 

P66 

16 

-0.18750 

1.10868 

-3.00000 

-2.00000 

2.00000 

P67 

16 

0.18750 

1.10868 

3.00000 

-2.00000 

2.00000 

P68 

16 

0.37500 

1.20416 

6.00000 

-2.00000 

2.00000 

P69 

16 

0.62500 

1.02470 

10.00000 

-2.00000 

2.00000 

Cronbach  Coefficient  Alpha 
for  RAW  variables  :  0,712362 

for  STANDARDIZED  variables:  0.720173 


Raw  Variables  Std.  Variables 

Deleted  Correlation  Correlation 

Variable  with  Total  Alpha  with  Total  Alpha 


P65 

P66 

P67 

P68 

P69 


0.063855 

0.368521 

0.659012 

0.640681 

0.742904 


0.816840 

0.703761 

0.584559 

0.586488 

0.557854 


0.056534 

0.384505 

0.666954 

0.646806 

0.742813 


0.822043 

0.709403 

0.593995 

0.602833 

0.559852 
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CoefTicient  Alpha  for  Coefficient  Alpha  for 

Standardized  Variables  Standardized  Variables 


Charts  and  Graphs 


ATT.  ABCDEF  GH 

EIS  Version 

Figure  11.  Coefficient  Alpha  for  MANNER  Construct 
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EIS  Version 


Figure  12.  Coefficient  Alpha  for  QUALITY  Construct 


Figure  13.  Coefficient  Alpha  for  QUANTITY  Construct 
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Coefficient  Alpha  for  Coefficient  Alpha  for 

Standardized  Variables  Standardized  Variables 


Figure  15.  Coefficient  Alpha  for  USABILITY  Construct 
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CoefHcient  Alpha  for 
Standardized  Variables 


Appendix  D:  Statistix  Files 

Oneral  Dasftriptiftn-  This  appendix  Contains  the  database  used  by  the  Statistix  program  and  the  various 
resulting  outputs.  It  is  divided  into  the  following  sections; 

Raw  Data . . . . page  138 

Summated  Data  and  Ranked  Sununated  Data . 140 

Descriptive  Statistics  -  Sununated  Constructs . . . 142 

Histograms . 144 

Box  and  Whiskers  Plots . 149 

Wilk-Shapiro/Rankit  Plots . 154 

Tuk^  Analyses  -  Summated  Ratings  by  Construct . 164 

Tukey  Analyses  -  Subject  Preferences . . . 165 

Wilk-Shapiro/Rankit  Plots  of  ANOVA  Residuals . 166 

Spearman  Rank  Correlation  -  Raw  Data . . 171 

Spearman  Rank  Correlation  -  Summated  Data  by  Version . 172 

Spearman  Rank  Coefficient  of  Correlation  Plots  by  Construct . 175 


137 


Data  Files 


Raw  Data 

Q 


U 

C 

C 

R 

U 

M 

Q 

Q 

R 

Q 

R 

M 

Q 

T 

Q 

Q 

M 

S 

0 

0 

E 

s 

A 

T 

L 

E 

T 

E 

A 

T 

Y 

L 

L 

A 

G 

V 

E 

H 

H 

L 

E 

N 

Y 

T 

L 

Y 

L 

N 

Y 

1 

T 

T 

N 

R 

E 

0 

0 

0 

0 

0 

0 

0 

0 

0 

1 

1 

1 

1 

3 

1 

1 

1 

CASE 

SUBJ 

P 

EIS 

SECT 

R  CUES 

1 

2 

3 

4 

5 

6 

7 

8 

9 

0 

1 

2 

3 

R 

4 

5 

6 

1 

6 

6 

BAFB 

EE 

A  NOWS 

1 

1 

1 

1 

1 

1 

0 

0 

1 

0 

1 

1 

0 

-0 

0 

-1 

1 

2 

14 

6 

BAFB 

EE 

A  NOWS 

1 

1 

1 

1 

1 

1 

1 

0 

1 

-1 

1 

1  ~1 

1 

0 

1 

1 

3 

22 

6 

BAFB 

EE 

A  NOWS 

0 

1 

1 

0 

-1 

1 

0 

0 

0 

0 

0 

-1 

0 

-0 

0 

0 

0 

4 

30 

6 

BAFB 

EE 

A  NOWS 

0 

0 

1 

1 

0 

1 

1 

0 

0 

0 

0 

0 

0 

-0 

0 

0 

0 

5 

7 

7 

BAFB 

PN 

A  NOWS 

2 

1 

1 

1 

1 

2 

1 

1 

1 

“I 

1 

1  -1 

1 

1 

1 

1 

6 

15 

7 

BAFB 

PN 

A  NOWS 

1 

1 

1 

1 

1 

1 

1 

1 

1 

~1 

0 

1  -1 

1 

1 

1 

1 

7 

23 

7 

BAFB 

PN 

A  NOWS 

2 

2 

2 

2 

2 

2 

2 

2 

2 

-1 

2 

2  -1 

1 

2 

2 

2 

8 

31 

7 

BAFB 

PN 

A  NOWS 

2 

2 

1 

1 

2 

2 

1 

1 

2 

-2 

1 

1  -2 

2 

1 

1 

2 

9 

8 

8 

DRP 

EE 

A  NOWS 

-2 

0 

0 

0 

0 

0 

1 

0 

0 

1 

0 

0  -2 

2 

0 

0 

0 

10 

16 

8 

DRP 

EE 

A  NOWS 

0 

-1 

1 

-1 

1 

0 

~1 

0 

-1 

1 

0 

1  ~1 

1 

0 

0 

“1 

11 

24 

8 
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EE 
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0 
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“1 
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1 

-1 
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1 

0 

-1 

0 

12 

32 

8 

DRP 

EE 
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-2 

-2 

-*2 

-2 

-2 

-2 

“2 

0 

-2 

1 

-1 

-1  -1 

1 

0 

0 

“2 

13 

1 

1 

DRP 

PN 

A  NOWS 

2 

2 

2 

2 

2 

2 

2 

0 

1 

-1 

1 

1  -1 

1 

2 

1 

2 

14 

9 

1 

DRP 

PN 

A  NOWS 

~1 

-1 

“1 

-2 

-1 

“2 

-2 

0 

-2 

1 

-2 

-1  -1 

1 

0 

0 

”2 

15 

17 

1 
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PN 
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-1 

-2 

1 

1 

-1 

-1 

1 

0 

-1 

1 

~1 

“1  -1 

1 

0 

0 

“1 

16 

7 

7 

BAFB 

EE 

B  NOTY 

~1 

0 

1 

1 

-1 

0 

1 

0 

0 

0 

1 

1  “1 

1 

0 

0 

0 

17 

15 

7 

BAFB 

EE 

B  NOTY 

1 

1 

1 

1 

1 

1 

1 

1 

1 

-1 

1 

1  -1 

1 

1 

1 

1 

18 

23 

7 

BAFB 

EE 
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2 

2 

2 

2 

2 

2 

2 

2 

2 

-1 

2 
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1 

2 

2 

2 

19 

31 

7 
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EE 

B  NOTY 

1 

1 

1 

2 

2 

1 

2 

1 

1  ■ 

~2 

1 

1 

0 

-0 

0 

0 

1 

20 

8 

8 
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PN 

B  NOTY 

1 

1 

0 

1 

1 

1 

1 

1 

1 

~1 

1 

1  “1 

1 

1 

1 

1 

21 

16 

8 

BAFB 

PN 

B  NOTY 

1 

1 

1 

1 

1 

•  1 

“1 

0 

0 

~1 

0 
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1 

0 

0 

1 

22 

24 

8 

BAFB 

PN 

B  NOTY 

0 

0 

1 

“1 

-1 

”-1 

-1 

0 

-1 

-1 
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56  12  4  DRP  PN  D  NOSY  122111111011-11111 

57  20  4  DRP  PN  D  NOSY  -1-1  0  0-1  0-1  1-1  2  0-1-1  1  1  1-1 

58  28  4  DRP  PN  D  NOSY  -1  -1  -1  -1  -2  -1  -1  0-1  1-1-1  1-1  0  0  -1 

59  2  2  BAFB  EE  E  LING  111122001  -1  110  -0  001 

60  10  2  BAFB  EE  E  LING  111221002  -1  21  -1  1012 

61  18  2  BAFB  EE  E  LING  111111101-1-11-110-11 

62  26  2  BAFB  EE  E  LING  -2-2-1  0-2-1  0  0-1  0  0  0  0-0  0  1-1 

63  3  3  BAFB  PN  E  LING  111101001  -1  002  -2  111 

64  11  3  BAFB  PN  E  LING  1  -1  -1  -2  -1  -1  -1  0-2  1  -2  -1-2  2  0  -1  -1 

65  27  3  BAFB  PN  E  LING  111111001  -1  11  -1  1001 

66  44  DRP  EE  E  LING  -1-1  1  0-1  2-1  0-1  1-1-1  0-0  1  1  -1 

67  12  4  DRP  EE  E  LING  111111121-110-11111 

68  20  4  DRP  EE  E  LING  1  0  1-1  0-1  1  1-1  2  -1  -1  -2  2  1  1-1 

69  28  4  DRP  EE  E  LING  -1  -1  -1  -1  -1  -1  -1  0-1  1  -1  -1  -1  1  0  1  -1 

70  5  5  DRP  PN  E  LING  102111101  -1  01  -1  1001 

71  13  5  DRP  PN  E  LING  0-1  0-1  -1  -1  -1  -1-2  0-2  0  1  -1  -1  -1  -1 

72  21  5  DRP  PN  E  LING  0  0  1-1-1  0-1  0-1  0-1  0-1  1  0  0-1 

73  29  5  DRP  PN  E  LING  -1  -1  1  -1  -1  -1  0  0  -1  -1  -1-1  1-1  0  0  -1 

74  3  3  BAFB  EE  F  VIS  -1  -1  11110000110  -0  0  -1  1 

75  11  3  BAFB  EE  F  VIS  211122111-111-11012 

76  27  3  BAFB  EE  F  VIS  1111110010110  -0  001 

77  4  4  BAFB  PN  F  VIS  0111101110100-0  111 

78  12  4  BAFB  PN  F  VIS  222112221  -1  122  -2  121 

79  20  4  BAFB  PN  F  VIS  20100-101-1101-1111-1 

80  28  4  BAFB  PN  F  VIS  111111101-111-11011 

81  5  5  DRP  EE  F  VIS  -1  -1  1  -1  -1  1-2  0-1  0  -2  -1  -1  1  0-1  0 

82  13  5  DRP  EE  F  VIS  -1  -1  -1  0  -1  1  0  0  0  1  0  0  -1  1  0  1  0 

83  21  5  DRP  EE  F  VIS  -1-1  0-1  0  0  0  0-1  1  -1  -1  -1  1  0  0  0 

84  29  5  DRP  EE  F  VIS  -2  -1  -2  -1  -2-1  0  0-1  1-1-1  1-1  0  0  -1 

85  6  6  DRP  PN  F  VIS  1110  -1  0001  -1  101  -1  0  -1  1 

86  14  6  DRP  PN  F  VIS  110000100  -1  00  -1  1000 

87  22  6  DRP  PN  F  VIS  1  0  1  0-1-1  1  0  0  1  0-1-1  1  0  0-1 

88  30  6  DRP  PN  F  VIS  0  -1  -1  -1  -1  -1  -1  0  -1  -1  -1-1  0-0  0  0  -1 

89  4  4  BAFB  EE  G  ALL  0010010000010  -0  -1  00 

90  12  4  BAFB  EE  G  ALL  122221211  -1  12  -1  1112 

91  20  4  BAFB  EE  G  ALL  -1  -1  -1  -1  -2  1  1  1-1  1  0-1-1  1  1  1  -1 

92  28  4  BAFB  EE  G  ALL  111111001-111-11011 

93  5  5  BAFB  PN  G  ALL  111111101-111-11001 

94  13  5  BAFB  PN  G  ALL  111011000  -1  00  -1  1011 

95  21  5  BAFB  PN  G  ALL  111111101-111-11011 

96  29  5  BAFB  PN  G  ALL  111111001  -1  11  -1  1001 

97  66  DRP  EE  G  ALL  -1-1-1  1-2-1  0  0  1  0  1-1  0-0  0  1-1 

98  14  6  DRP  EE  G  ALL  -1  -1  -1  -2  -1  -1  -1  -1  -1  1  -1  -1  -1  1-1  0  -1 

99  22  6  DRP  EE  G  ALL  -1  -2  0-1-1  0-1  0  -1  -1  -1  -1  0  -0  -1  -1  -1 

100  30  6  DRP  EE  G  ALL  -1  0  1  1  1  0  0  0  0  1  -1  0  -1  1  0  0  0 

101  7  7  DRP  PN  G  ALL  211121101-111-11001 

102  15  7  DRP  PN  G  ALL  -1  0  1  0-1  0-1  0  0  1-1  0-1  1  0  0-1 

103  23  7  DRP  PN  G  ALL  22.2222222  -1  22  -1  1222 

104  31  7  DRP  PN  G  ALL  111012-101-2  111-1001 

105  5  5  BAFB  EE  H  NONE  -1  211  -1  10010110  -0  001 

106  13  5  BAFB  EE  H  NONE  111  1  11001  -2  010  -0  001 

107  21  5  BAFB  EE  H  NONE  1-1  0-1  1-1  0  0  -1  -1  -1  -1  -1  1  0  0  -1 

108  29  5  BAFB  EE  H  NONE  011111001011  -1  1001 

109  6  6  BAFB  PN  H  NONE  2222220010120  -0  012 

110  14  6  BAFB  PN  H  NONE  001100000  -1  00  -1  1011 

111  22  6  BAFB  PN  H  NONE  0  1  1  0-1-1  0  0  0  0-1-1  0-0  0  0-1 

112  30  6  BAFB  PN  H  NONE  000000000001  -1  1000 

113  7  7  DRP  EE  H  NONE  1  -1  0001100100  -1  1010 

114  15  7  DRP  EE  H  NONE  0  0  1  1  0-1-1  0  0  2  -1  -1  -1  1  0  0  0 

115  23  7  DRP  EE  H  NONE  222222222  -1  22  -1  1222 

116  31  7  DRP  EE  H  NONE  -1  -1  0  0-1  1-1  0  -1  -1  -1-1  0-0  0  0  -2 

117  8  8  DRP  PN  H  NONE  000000001100  -2  2000 

118  16  8  DRP  PN  H  NONE  1-111000102-10-22000 

119  24  8  DRP  PN  H  NONE  -1  -1  0-1-1  0  -1  -1-2  1  0-1-1  1  0  -2  -1 

120  32  8  DRP  PN  H  NONE  -1  -1  0  -1  -1  -1  -1  1-2  0  -1  -1  0-0  0  -1  -1 
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Descriptive  Statistics  -  Summated  Constructs 


DESCRIPTIVE  STATISTICS  FOR  CUES  =  ALL  (Both  Linguistic  and  Visual  Cues  are  Co- 
hesive) 


N 

MEAN 

SD 

MINIMUM 

MEDIAN 

MAXIMUM 


COHERENC 

16 

1,0625 

2,0156 

-2,0000 

2.0000 

4.0000 


USABLTY 

16 

0.6875 

2.4144 

-3.0000 

2.0000 

4.0000 


MANNER 

16 

1.5000 
2.8048 

-3.0000 

2.5000 

6.0000 


RELATION 

16 

1.2500 

2.7689 

-4.0000 

2.5000 

6.0000 


QUALITY 

16 

0.6875 

1.9906 

-2.0000 

0.0000 

6.0000 


DESCRIPTIVE  STATISTICS  FOR  CUES  =  LING 


(Only  Linguistic  Cues  are  Cohesive) 


N 

MEAN 

SD 

MINIMUM 

MEDIAN 

MAXIMUM 


COHERENC 

15 

0.5333 

1.7674 

-3.0000 

1.0000 

2.0000 


USABLTY 

15 

0.2667 

2.1536 

-4.0000 

1.0000 

3.0000 


MANNER 

15 

0,2667 

2,8149 

-3.0000 

0.0000 

4.0000 


RELATION 

15 

-0.4000 

3.5010 

-6.0000 

-1.0000 

6.0000 


QUALITY 

15 

0.6000 

1.7238 

-3.0000 

0.0000 

4,0000 


DESCRIPTIVE  STATISTICS  FOR  CUES  =  NONE  (Neither  Linguistic  Nor  Visual  Cues  are 
Cohesive) 


N 

MEAN 

SD 

MINIMUM 

MEDIAN 

M2\XIMUM 


COHERENC 

16 

0.8750 

1.7842 

-1.0000 

0.5000 

4.0000 


USABLTY 

16 

0.3750 

1.9621 

-2.0000 

0.0000 

4.0000 


MANNER 

16 

0.5625 

3.0104 

-3.0000 

0.5000 

6.0000 


RELATION 

16 

0.4375 

2.7318 

-4.0000 

0.0000 

6.0000 


QUALITY 

16 

0.4375 

1.7500 

-3.0000 

0.0000 

6.0000 


DESCRIPTIVE  STATISTICS  FOR  CUES  =  NOSY  (Syntax  Cues  are  Non-cohesive) 


N 

MEAN 

SD 

MINIMUM 

MEDIAN 

MAXIMUM 


COHERENC 

14 

0.8571 

2.1432 

-2.0000 

2.0000 

4.0000 


USABLTY 

14 

0.5000 

2.1031 

-3.0000 

1,0000 

4.0000 


MANNER 

14 

0.5714 

3-1062 

-4.0000 

3.0000 

4.0000 


RELATION 

14 

0.6429 

2.7346 

-4.0000 

1.5000 

4.0000 


QUALITY 

14 

0.5000 

1.4544 

-2.0000 

0.0000 

3.0000 


DESCRIPTIVE  STATISTICS  FOR  CUES  =  NOTS  (Tense  Cues  are  Non-cohesive) 


N 

MEAN 

SD 

MINIMUM 

MEDIAN 

MAXIMUM 


COHERENC 

14 

0.9286 

1.7305 

-3.0000 

1.5000 

4.0000 


USABLTY 

14 

0.4286 

2.0273 

-2.0000 

0.5000 

4.0000 


MANNER 

14 

0.9286 

3.0500 

-5.0000 

2.0000 

6.0000 


RELATION 

14 

0.2857 

3.0742 

-4.0000 

-0.5000 

6.0000 


QUALITY 

14 

0.2857 

1.4373 

-3.0000 

0.0000 

3.0000 
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DESCRIPTIVE 

STATISTICS  FOR 

CUES  =  NOTY 

(Typographic  Cues  are 

Non- cohesive) 

COHERENC 

USABLTY 

MANNER 

RELATION 

QUALITY 

N 

15 

15 

15 

15 

15 

MEAN 

1.0000 

0.7333 

1.0667 

0.3333 

0.4667 

SD 

1.8127 

2.2509 

3.3905 

3.5790 

2.1668 

MINIMUM 

-2.0000 

-2.0000 

-4.0000 

-5.0000 

-3.0000 

MEDIAN 

1.0000 

2.0000 

2.0000 

0.0000 

0.0000 

MAXIMUM 

4.0000 

4.0000 

6.0000 

6.0000 

6.0000 

DESCRIPTIVE 

STATISTICS  FOR 

CUES  =  NOWS 

(White  Space 

Cues  are 

Non- cohesive) 

COHERENC 

USABLTY 

MANNER 

RELATION 

QUALITY 

N 

15 

15 

15 

15 

15 

MEAN 

1.0000 

0.7333 

1.0000 

0.6667 

1.1333 

SD 

2.2039 

2.5486 

3.5657 

3.4157 

1.9952 

MINIMUM 

-4.0000 

-4.0000 

-5.0000 

-6.0000 

-1.0000 

MEDIAN 

2.0000 

1.0000 

1.0000 

1.0000 

0.0000 

MAXIMUM 

4.0000 

4.0000 

6.0000 

6.0000 

6-0000 

DESCRIPTIVE 

STATISTICS  FOR 

CUES  =  VIS 

(Only  Visual 

Cues  are  Cohesive) 

COHERENC 

USABLTY 

MANNER 

RELATION 

QUALITY 

N 

15 

15 

15 

15 

15 

MEAN 

0.6000 

0.3333 

0.7333 

0.3333 

0.8000 

SD 

1.9198 

2.1269 

2.6851 

2.6095 

1.7403 

MINIMUM 

-3.0000 

-4.0000 

-3.0000 

-4.0000 

-1.0000 

MEDIAN 

1.0000 

0.0000 

1.0000 

0.0000 

0-0000 

MAXIMUM 

4.0000 

4.0000 

5.0000 

3.0000 

5.0000 
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Complete  Data  Set  —  Subjective  and  Demographic  Questions 


Histogram 


COHERENC 


Figure  17.  Histogram:  COHERENCE 


Complete  Data  Set  —  Subjective  and  Demographic  Questions 


Histogram 


MANNER 

Figure  18.  Histogram:  MANNER 
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QUALITY 

Figure  19.  Histogram:  QUALITY 


Complete  Data  Set  —  Subjective  and  Demographic  Questi 


Histogram 


- - - -r - 

-6  -4-2  0  2 

RELATION 


Figure  20.  Histogram;  RELATION 


Complete  Data  Set  —  Subjective  and  Demographic  Questions 

Histogram _ 


Figure  21.  Histogram:  USABH.ITY 


Complete  Data  Set  —  Subjective  and  Demographic  Questions 


Histogram 


DRP  Section  Preference 


Figure  22.  Histogram:  Question  P6S 
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BAFB  Section  Preference 

Figure  23.  Histogram:  Question  P66 


Complete  Data  Set  —  Subjective  and  Demographic  Questions 

_ Histogram _ 

60  4 . . 


Purpose  &  Need  Section  Preference 

Figure  24.  Histogram:  Question  P67 


147 


Complete  Data  Set  —  Subjective  and  Demographic  Questions 

Histogram 


-10  1 
Environmental  Effects  Section  Preference 

Figure  25.  Histogram:  Question  P68 


Complete  Data  Set  —  Subjective  and  Demographic  Questions 


Histogram 


Overall  EIS  Section  Preference 

Figure  26.  Histogram:  Question  P69 
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MANNER  COHERENC 


Box  and  Whiskers  Plots 


Complete  Data  Set  —  Subjective  and  Demographic  Questions 


Box  and  Whisker  Plot 


A  B  C  D  E  F  G 


ElS/Section  Version. 

120  cases 

Figure  27.  Box  and  Whiskers  Plot;  COHERENCE 


Complete  Data  Set  —  Siibjective  and  Demographic  Questions 


Box  and  Whisker  Plot 


ElS/Section  Version 

120  cases 


Figure  28.  Box  and  Whiskers  Plot:  MANNER 


5 


Complete  Data  Set  —  Subjective  and  Demographic  Questions 

Box  and  Whisker  Plot 


B  C  D  E  F  G 


ElS/Section  Version 

120  cases 

Figure  33.  Box  and  Whiskers  Plot:  Question  P66 


Complete  Data  Set  —  Subjective  and  Demographic  Questions 


Box  and  Whisker  Plot 


ElS/Section  Version 

120  cases 


Figure  34.  Box  and  Whiskers  Plot:  Question  P67 


Wilk-Shaoiro/Rankit  Plots 


Rankits 

J^proximate  ¥ilk-Shapiro  0.9257  120  cases 

Figure  37.  Wllk  Shapiro/Rankit  Plot:  COHERENCE 


Con^lete  Data  Set  —  Subjective  and  Demographic  Questions 


Rankits 

Approxixoate  Wilk-Shapiro  0.  9302  120  cases 

Figure  38.  Wilk  Shapiro/Rankit  Plot:  MANNER 
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and  Demographic  Questions 


Complete  Data  Set  —  Subjective 


Wilk-Shapiro  /  Rankit  Plot  of  QUALITY 


Figure  39.  Wilk  Shapiro/Rankit  Plot:  QUALITY 


Complete  Data  Set  —  Subjective  and  Demographic  Questions 


Wilk— Shapiro  /  Rankit  Plot  of  RELATION 


Figure  40.  Wilk  Shapiro/Rankit  Plot:  RELATION 


Complete  Data  Set  —  Subjective  and  Demographic  Questiona 


Wilk-Shapiro  /  Rankit  Plot  of  USEABLTY 


Rankits 

Approximate  ¥ilk-Shapiro  0.9360  120  cases 

Figure  41.  Wilk  Shapiro/Raakh  Plot:  USABILITY 


Complete  Date  Set  —  Siabjective  and  Demographic  Questions 

Wilk-Shapiro  /  Rankit  Plot  of  P65 


©- . O— &-0-DOOO 


■-0000-0-^3-"0 


-1  0  1 

Rankits 

Approximate  Wilk-Shapiro  0.8801  120  cases 


Figure  42.  Wilk  Shapiro/Rankit  Plot:  Question  P65 
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Ordered  Data  Ordered  Data 


Complete  Data  Set  —  Subjective  and  Demographic  Questions 


Wilk“Shapiro  /  Rankit  Plot  of  P66 


Rankits 

Approximate  Vilk-Shapiro  0.9202  120  cases 

Figure  43.  Wilk  Shapiro/Rankit  Plot:  Question  P66 


Complete  Data  Set  —  Subjective  and  Demographic  Questions 


Wilk-Shapiro  /  Rankit  Plot  of  P67 


Figure  44.  Wilk  Shapiro/Rankit  Plot:  Question  P67 
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Conqjlete  Data  Set  —  Subjective  and  Demographic  Questions 


Wilk-Shapiro  /  Rankit  Plot  of  P68 


Hankiis 

i^proximate  Vilk-Shapiro  0.8753  120  cases 

Figure  45.  Wilk  Shapiro/Rankit  Plot:  Question  P68 


Complete  Data  Set  —  Subjective  and  Demographic  Questions 


Wilk-Shapiro  /  Rankit  Plot  of  P69 


Figure  46.  Wilk  Shapiro/Rankit  Plot:  Question  P69 
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ANOVA 


ONE-WAY 

AOV  FOR 

COHERENC  BY 

VER 

SOURCE 

DF 

ss 

MS 

F 

P 

BETWEEN 

7 

3.92798 

0.56114 

0.15 

0.9925 

WITHIN 

112 

416.664 

3.72021 

TOTAL 

119 

420.592 

CHI-SQ 

DF 

P 

BARTLETT'S  TEST 

OF  - 

— 

EQUAL  VARIANCES  1.64 

7  0. 

9772 

COCHRAN 

'S  Q 

0.1631 

LARGEST 

VAR  /  SMALLEST  VAR 

1.6220 

COMPONENT  OF  VARIANCE  FOR  BETWEEN  GROUPS  -0.21067 


EFFECTIVE 

CELL 

SIZE 

SAMPLE 

15.0 

GROUP 

VER 

MEAN 

SIZE 

STD  DEV 

A 

1.0000 

15 

2.2039 

B 

1.0000 

15 

1.8127 

C 

0.9286 

14 

1.7305 

D 

0.8571 

14 

2-1432 

E 

0.5333 

15 

1.7674 

F 

0.6000 

15 

1.9198 

G 

1.0625 

16 

2.0156 

H 

0.8750 

16 

1.7842 

TOTAL 

0.8583 

120 

1.9288 

CASES  INCLUDED 

120 

MISSING  CASES  0 

ONE-WAY  AOV  FOR  USABLTY  BY  VER 

SOURCE 

DF 

SS 

MS 

F  P 

BETWEEN  7  3.74226  0.53461  0.11  0.9969 

WITHIN  112  546.249  4.87723 

TOTAL  119  549.992 


CHI-SQ  DF  P 

BARTLETT'S  TEST  OF  -  -  - 

EQUAL  VARIANCES  1.54  7  0.9809 

COCHRAN’S  Q  0.1668 

LARGEST  VAR  /  SMALLEST  VAR  1.6871 

COMPONENT  OF  VARIANCE  FOR  BETWEEN  GROUPS  -0.28960 
EFFECTIVE  CELL  SIZE  15.0 


VER 

MEAN 

SAMPLE 

SIZE 

GROUP 
STD  DEV 

A 

0.7333 

15 

2.5486 

B 

0.7333 

15 

2.2509 

C 

0.4286 

14 

2.0273 

D 

0.5000 

14 

2.1031 

E 

0.2667 

15 

2.1536 

F 

0.3333 

15 

2.1269 

G 

0.6875 

16 

2.4144 

H 

0.3750 

16 

1.9621 

TOTAL 

0.5083 

120 

2.2084 

CASES  INCLUDED 

120  MISSING  CASES  0 
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ONE-WAY  AOV  FOR  MANNER  BY  VER 

SOURCE  DF  SS  MS  F  P 


BETWEEN  7  15.5720 
WITHIN  112  1051.09 
TOTAL  119  1066.67 


2.22457 

9.38477 


0.24  0.9741 


CHI-SQ 

BARTLETT'S  TEST  OF  - 

EQUAL  VARIANCES  1.85 


DF  P 

7  0.9679 


COCHRAN'S  Q  0.1690 

LARGEST  VAR  /  SMALLEST  VAR  1.7635 


COMPONENT  OF  VARIANCE  FOR  BETWEEN  GROUPS 
EFFECTIVE  CELL  SIZE 


VER 

MEAN 

SAMPLE 

SIZE 

GROUP 
STD  DEV 

A 

1,0000 

15 

3.5657 

B 

1.0667 

15 

3.3905 

C 

0.9286 

14 

3.0500 

D 

0.5714 

14 

3.1062 

E 

0.2667 

15 

2.8149 

F 

0.7333 

15 

2.6851 

G 

1.5000 

16 

2.8048 

H 

0.5625 

16 

3.0104 

TOTAL 

0.8333 

120 

3.0635 

CASES  INCLUDED 

120 

MISSING 

CASES  0 

-0.47750 

15.0 


ONE-WAY  AOV  FOR  RELATION  BY  VER 

SOURCE  DF  SS  MS  F  P 


BETWEEN  7  23.0911 
WITHIN  112  1056.61 
TOTAL  119  1079.70 


3.29872 

9.43401 


0.35  0.9286 


CHI-SQ 

BARTLETT'S  TEST  OF  - 

EQUAL  VARIANCES  3.18 


DF  P 

7  0.8675 


COCHRAN'S  Q  0.1694 

LARGEST  VAR  /  SMALLEST  VAR  1.8811 


COMPONENT  OF  VARI7\NCE  FOR  BETWEEN  GROUPS  -0.40915 
EFFECTIVE  CELL  SIZE  15.0 


VER 

MEAN 

SAMPLE 

SIZE 

GROUP 
STD  DEV 

A 

0.6667 

15 

3.4157 

B 

0.3333 

15 

3.5790 

C 

0.2857 

14 

3.0742 

D 

0.6429 

14 

2.7346 

E 

'0.4000 

15 

3.5010 

F 

0.3333 

15 

2.6095 

G 

1.2500 

16 

2.7689 

H 

0.4375 

16 

2.7318 

TOTAL 

0.4500 

120 

3.0715 

CASES  INCLUDED 

120 

MISSING 

CASES  0 
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ONE-WAY  AOV  FOR  QUALITY  BY  VER 


SOURCE 

DF 

SS 

MS 

F  P 

BETWEEN 

7 

7.16786 

1.02398 

0.31  0,9456 

WITHIN 

112 

365.199 

3.26070 

TOTAL 

119 

372.367 

CHI-SQ  DF  P 

BARTLETT'S  TEST  OF  -  -  - 

EQUAL  VARIANCES  3.91  7  0.7906 

COCHRAN'S  Q  0.1814 

LARGEST  VAR  /  SMALLEST  VAR  2.2727 

COMPONENT  OF  VARIANCE  FOR  BETWEEN  GROUPS  -0.14916 
EFFECTIVE  CELL  SIZE  15.0 


VER 

MEAN 

SAMPLE 

SIZE 

GROUP 
STD  DEV 

A 

1.1333 

15 

1.9952 

B 

0.4667 

15 

2.1668 

C 

0.2857 

14 

1.4373 

D 

0.5000 

14 

1.4544 

E 

0.6000 

15 

1.7238 

F 

0.8000 

15 

1.7403 

G 

0.6875 

16 

1.9906 

H 

0.4375 

16 

1.7500 

TOTAL 

0.6167 

120 

1,8057 

CASES  INCLUDED  120  MISSING  CASES  0 
ONE-WAY  AOV  FOR  P65  BY  VER 

SOURCE  DF  SS  MS  F  P 


BETWEEN  7  12.0060  1.71514  1.41  0.2059 

WITHIN  112  135.861  1.21304 

TOTAL  119  147.867 

CHI-SQ  DF  P 

BARTLETT'S  TEST  OF  -  ______  - 

EQUAL  VARIANCES  1.87  7  0.9669 

COCHRAN'S  Q  0.1695 

LARGEST  VAR  /  SMALLEST  VAR  1.8633 

COMPONENT  OF  VARIANCE  FOR  BETWEEN  GROUPS  0.03348 
EFFECTIVE  CELL  SIZE  15.0 


VER 

MEAN 

SAMPLE 

SIZE 

GROUP 
STD  DEV 

A 

-0.0667 

15 

1.2799 

B 

-0.3333 

15 

1.1751 

C 

-0.5714 

14 

0.9376 

D 

-0.2857 

14 

1.0690 

E 

3.701E-18 

15 

1.0000 

F 

0.2667 

15 

1.0328 

G 

0.4375 

16 

1.0935 

H 

0.1875 

16 

1.1673 

TOTAL 

-0.0333 

120 

1.1014 

CASES 

INCLUDED  120 

MISSING 

CASES  0 
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ONE-WAY  AOV  FOR  P66  BY  VER 


SOURCE 

DF 

ss 

MS  F 

P 

BETWEEN 

7 

9.53929 

1.36276  1.07 

0.3900 

WITHIN 

112 

143.127 

1.27792 

TOTAL 

119 

152.667 

CHI-SQ 

DF  P 

BARTLETT 

'S  TEST  OF  - 

-  - 

EQUAL 

VARIANCES  0.30 

7  0.9999 

COCHRAN’ 

s  Q 

0.1417 

LARGEST 

VAR  / 

SMALLEST  VAR 

1.2383 

COMPONENT 

OF  VARIANCE 

FOR  BETWEEN 

GROUPS 

0.00566 

EFFECTIVE 

CELL  SIZE 

SAMPLE 

GROUP 

15.0 

VER 

MEAN 

SIZE 

STD  DEV 

A 

-0.2000 

15 

1.0823 

B 

1.665E-17 

15 

1.1952 

C 

0.2857 

14 

1.2044 

D 

0.5714 

14 

1.0894 

E 

0.5333 

15 

1.1255 

F 

0.3333 

15 

1.1127 

G 

0.0625 

16 

1.1236 

H 

-0.1875 

16 

1.1087 

TOTAL 

0.1667 

120 

1.1305 

CASES  INCLUDED  120 

MISSING  CASES  0 

ONE-WAY  AOV  FOR  P67  BY  VER 

SOURCE 

DF  ss 

MS 

F 

P 

BETWEEN 

7  4.29345  0.61335  0.47 

0.8531 

WITHIN  112  145.173  1.29619 

TOTAL  119  149.467 

CHI-SQ  DF  P 

BARTLETT'S  TEST  OF  -  -  - 

EQUAL  V7\RIANCES  2.55  7  0.9232 

COCHRAN'S  Q  0.1571 

lARGEST  VAR  /  SMALLEST  VAR  1.9545 


COMPONENT  OF  VARIANCE  FOR  BETWEEN  GROUPS  -0.04554 
EFFECTIVE  CELL  SIZE  15.0 


STAPLE 

GROUP 

VER 

MEAN 

SIZE 

STD  DEV 

A 

0.0667 

15 

1.2228 

B 

•0.0667 

15 

1.2799 

C 

0.0714 

14 

1.2688 

D 

0.2857 

14 

1-2044 

E 

0.4000 

15 

1.0556 

F 

0.5333 

15 

0.9155 

G 

0.3750 

16 

1.0247 

H 

0.1875 

16 

1.1087 

TOTAL 

0.2333 

120 

1.1385 

CASES  INCLUDED 

120 

MISSING 

CASES  0 
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ONK-WAY  AOV  FOR  P68  BY  VER 


SOURCE 

DF 

SS 

MS 

F  P 

BETTi?EEN 

7 

3.27857 

0.46837 

0.38  0,9115 

WITHIN 

112 

137.521 

1.22787 

TOTAL 

119 

140.800 

CHI-SQ  DF  P 

BARTLETT'S  TEST  OF  -  -  - 

EQUAL  VARIANCES  1.29  7  0.9886 

COCHRAN'S  Q  0.1481 

LARGEST  VAR  /  SMALLEST  VAR  1.6091 

COMPONENT  OF  VARIANCE  FOR  BETWEEN  GROUPS  -0.05065 
EFFECTIVE  CELL  SIZE  15.0 


VER 

MEAN 

SAMPLE 

SIZE 

GROUP 
STD  DEV 

A 

0,4000 

15 

1.1832 

B 

0.6000 

15 

1.1832 

C 

0.7143 

14 

1.1387 

D 

0.8571 

14 

0.9493 

E 

0.8000 

15 

1.0142 

F 

0.6000 

15 

1.0556 

G 

0,5000 

16 

1.0954 

H 

0.3750 

16 

1.2042 

TOTAL 

0,6000 

120 

1.1081 

CASES  INCLUDED 

120  MISSING  CASES  0 

ONE-WAY  AOV  FOR  BY 

VER 

SOURCE  DF 

SS 

MS 

5  F 

BETWEEN  7  0.87143  0.12449  0.12  0.9959 

WITHIN  112  114.995  1.02674 

TOTAL  119  115.867 

CHI-SQ  DF  P 

BARTLETT'S  TEST  OF  -  -  - 

EQUAL  VARIANCES  0.46  7  0.9996 

COCHRAN'S  Q  0.1422 

LARGEST  VAR  /  SMALLEST  VAR  1.3213 

COMPONENT  OF  VARIANCE  FOR  BETWEEN  GROUPS  -0.06017 
EFFECTIVE  CELL  SIZE  15.0 


VER 

MEAN 

SAMPLE 

SIZE 

GROUP 
STD  DEV 

A 

0.6667 

15 

1.0465 

B 

0.4667 

15 

1.0601 

C 

0.6429 

14 

1.0818 

D 

0.6429 

14 

1,0082 

E 

0.6000 

15 

0.9856 

F 

0.8000 

15 

0.9411 

G 

0.6250 

16 

0.9574 

H 

0.6250 

16 

1.0247 

TOTAL 

0.6333 

120 

1.0133 

CASES  INCLUDED 

120  MISSING  CASES  0 
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Tukev  Analyses  -  Summated  Ratines  bv  Construct 


TUKEY  (HSD) 

PAIRWISE 

COMPARISONS  OF  MEANS  OF  COHERENCE  BY  VERSION 

VERSION 

MEAN 

HOMOGENEOUS  GROUPS 

G 

1.0625 

I 

B 

1.0000 

I 

A 

1.0000 

I 

C 

0.9286 

I 

H 

0.8750 

I 

D 

0.8571 

I 

F 

0.6000 

I 

E 

0.5333 

I 

TUKEY  (HSD) 

PAIRWISE 

COMPARISONS  OF  MEANS  OF  MANNER  BY  VERSION 

VERSION 

MEAN 

HOMOGENEOUS  GROUPS 

G 

1.5000 

I 

B 

1.0667 

I 

A 

1.0000 

I 

C 

0.9286 

I 

F 

0.7333 

I 

D 

0.5714 

I 

H 

0.5625 

I 

E 

0.2667 

I 

TUKEY  (HSD) 

PAIRWISE 

COMPARISONS  OF  MEANS  OF  RELATION  BY  VERSION 

VERSION 

MEAN 

HOMOGENEOUS  GROUPS 

G 

1.2500 

I 

A 

0.6667 

I 

D 

0.6429 

I 

H 

0.4375 

I 

B 

0.3333 

I 

F 

0.3333 

I 

C 

0.2857 

I 

E 

’0.4000 

I 

TUKEY  (HSD) 

PAIRWISE 

COMPARISONS  OF  MEANS  OF  QUALITY  BY  VERSION 

VERSION 

MEAN 

HOMOGENEOUS  GROUPS 

A 

1.1333 

I 

F 

0.8000 

I 

G 

0.6875 

I 

E 

0.6000 

I 

D 

0.5000 

I 

B 

0.4667 

I 

H 

0.4375 

I 

C 

0.2857 

I 

TUKEY  (HSD) 

PAIRWISE 

COMPARISONS  OF  MEANS  OF  USABILITY  BY  VERSION 

VERSION 

MEAN 

HOMOGENEOUS  GROUPS 

A 

0.7333 

I 

B 

0.7333 

I 

G 

0.6875 

I 

D 

0.5000 

I 

C 

0.4286 

I 

H 

0.3750 

I 

F 

0.3333 

I 

E 

0.2667 

I 

THERE  ARE  NO  SIGNIFICANT  PAIRWISE  DIFFERENCES  AMONG  THE  MEANS. 

CRITICAL  Q  VALUE  4.367  REJECTION  LEVEL  0.050 

STANDARD  ERRORS  AND  ' 

CRITICAL  VALUES  OF  DIFFERENCES 

VARY  BETWEEN  COMPARISONS  BECAUSE  OF  UNEQUAL  SAMPLE  SIZES. 
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Tukev  Analyses  -  Subject  Preferences 


TUKEY  (HSD) 

PAIRWISE 

COMPARISONS  OF  MEANS  OF  QOESTIOlf  P65  BY 

VERSION 

VERSION 

MEAN 

HOMOGENEOUS  GROUPS 

G 

0.5000 

I 

E 

0.3750 

I 

D 

0.2857 

I 

F 

0.2500 

I 

H 

0.1250 

I 

C 

-0.4286 

I 

A 

-0.7143 

I 

B 

-0.8571 

I 

TUKEY  (HSD) 

PAIRWISE 

COMPARISONS  OF  MEANS  OF  QXJESTION  P66  BY 

VERSION 

VERSION 

MEAN 

HOMOGENEOUS  GROUPS 

F 

0.8571 

I 

E 

0.7143 

I 

G 

0.3750 

I 

D 

0.2857 

I 

H 

-0.1250 

I 

C 

-0.1429 

I 

A 

-0.2500 

I 

B 

-0.2500 

I 

TUKEY  (HSD) 

PAIRWISE 

COMPARISONS  OF  MEANS  OF  QUESTION  P67  BY 

VERSION 

VERSION 

MEAN 

HOMOGENEOUS  GROUPS 

F 

0.6250 

I 

E 

0.4286 

I 

D 

0.3750 

I 

H 

0.2500 

I 

C 

0.1667 

I 

G 

0.1250 

I 

B 

2.776E-17 

I 

A 

-0.1429 

I 

TUKEY  (HSD) 

PAIRWISE 

COMPARISONS  OF  MEANS  OF  QUESTION  P€8  BY 

VERSION 

VERSION 

MEAN 

HOMOGENEOUS  GROUPS 

E 

0.8750 

I 

D 

0.8333 

I 

F 

0.7143 

I 

C 

0.6250 

I 

B 

0.5714 

I 

G 

0.5000 

I 

H 

0.5000 

I 

A 

0.2500 

I 

TUKEY  (HSD) 

PAIRWISE 

COMPARISONS  OF  MEANS  OF  QUESTION  P69  BY 

VERSION 

VERSION 

MEAN 

HOMOGENEOUS  GROUPS 

F 

0.8000 

I 

A 

0.6667 

I 

C 

0.6429 

I 

D 

0.6429 

I 

G 

0.6250 

I 

H 

0.6250 

I 

E 

0.6000 

I 

B 

0.4667 

I 

THERE  ARE  NO  SIGNIFICANT  PAIRWISE  DIFFERENCES  AMONG  THE  MEANS. 

CRITICAL  Q 

VALUE  4.367  REJECTION  LEVEL  0.050 

STANDARD  ERRORS  AND  ' 

CRITICAL  VALUES  OF  DIFFERENCES 

VARY  BETWEEN  COMPARISONS  BECAUSE  OF  UNEQUAL  SAMPLE  SIZES. 
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Wilk-Shaoiro/Rankit  Plots  of  ANOVA  Residuals 
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Coaqplete  Data  Set  —  Subjective  and  Demographic  Questions 

Wilk-Shapiro  /  Rankit  Plot  of  COH  RES 
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Figure  47.  Normality  Plot  of  ANOVA  Residuals:  COHERENCE 
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Figure  48.  Normality  Plot  of  ANOVA  Residuals:  MANNER 
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Complete  Data  Set  —  Subjective  and  Demographic  Questions 


Wilk-Shapiro  /  Rankit  Plot  of  QLT  RES 


o 

o 

0  o 

0 

s 

aiP 

o 

o  °  ' 

00 

oo° 

0 

-2  -10  1  2 

Rankits 

Approximate  Vilk-Shapiro  0, 9275  120  cases 


Figure  49.  Normality  Plot  of  ANOVA  Residuals:  QUALITY 


Complete  Data  Set  —  Siibjective  and  Demographic  Questions 


Wilk-Shapiro  /  Rankit  Plot  of  REL  RES 
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Figure  50.  Normality  Plot  of  ANOVA  Residuals:  RELATION 


Ordered  Data  Ordered  Data 


CoiUJlete  Data  Set  —  Subjective  and  Demographic  Questions 


Rankits 

J^proximate  ¥ilk-Shapiro  0.9577  120  cases 

Figure  51.  Normality  Plot  of  ANOVA  Residuals:  USABILITY 


Complete  Data  Set  —  Subjective  and  Demographic  Questions 


Wilk-Shapiro  /  Rankit  Plot  of  P65_RES 
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Figure  52.  Normality  Plot  of  ANOVA  Residuals:  Question  P65 
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Ordered  Data  Ordered  Data 


Complete  Data  Set  —  Subjective  and  Demographic  Questions 


Wilk-Shapiro  /  Rankit  Plot  of  P66_RES 


Rankits 

Approximate  Vilk-Shapiro  0.9899  120  cases 


Figure  53.  Normality  Plot  of  ANOVA  Residuals:  Question  P66 


Complete  Data  Set  —  Subjective  and  Demographic  Questions 


Wilk-Shapiro  /  Rankit  Plot  of  P67_RES 


Rankits 

T^proximate  Wilk-Shapiro  0.9355  120  cases 

Figure  54.  Normality  Plot  of  ANOVA  Residuals:  Question  P67 
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Ordered  Data  Ordered  Data 


Complete  Data  Set  —  Subjective  and  Demographic  Questions 


Rankits 

Approximate'  Vilk-Shapiro  0. 9425  120  cases 

Figure  55.  Normality  Plot  of  ANOVA  Residuals:  Question  P68 


Complete  Data  Set  —  Subjective  and  Demographic  Questioiis 


Wilk-Shapiro  /  Rankit  Plot  of  P69_REIS 
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Figure  56.  Normality  Plot  of  ANOVA  Residuals:  Question  P69 
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spearman  Rank  Coefficient  of  Correlation  -  Raw  Data 


Complete  Data  Set  —  Subjective  and  Demographic  Questions  —  RAW  DATA 


SPEARMAN  RANK  CORRELATIONS,  CORRECTED  FOR  TIES 


USEOl 

COH02 

COHO  3 

REL04 

USE05 

MAN06 

QTY07 

COHO  2 

0.7170 

COHOS 

0.5721 

0.6907 

REL04 

0.5518 

0.7316 

0.7028 

USE05 

0.7540 

0.7596 

0.6408 

0.7424 

MAN06 

0.5783 

0.6930 

0.6035 

0.6583 

0.7337 

QTY07 

0.5317 

0.5886 

0.4795 

0.6484 

0.6061 

0.5471 

QLT08 

0.3625 

0.3891 

0.2827 

0.3197 

0.3526 

0.3059 

0.4422 

REL09 

0.6034 

0.7980 

0.5740 

0.8112 

0.7652 

0.7161 

0.6321 

QTYIO 

-0.4370 

-0.5179 

-0.3316 

-0.4418 

-0.4905 

-0.4222 

-0.3375 

RELll 

0.5897 

0.7429 

0.5186 

0.7188 

0.7066 

0.6872 

0.6188 

MAN12 

0.6280 

0.7926 

0.6452 

0.7740 

0.8122 

0,7439 

0.5986 

QTY13 

-0.1286 

-0.0438 

0.0049 

-0.0875 

-0.2023 

-0.0037 

-0.2266 

QTY13R 

0.1286 

0.0438 

-0.0049 

0.0875 

0.2023 

0-0037 

0.2266 

QLT14 

0.3459 

0.4183 

0.3143 

0.3613 

0.3069 

0.3486 

0.4489 

QLT15 

0.3449 

0.3917 

0.2271 

0.4218 

0.3350 

0.4071 

0.4554 

MAN16 

0.6476 

0.8442 

0.6623 

0.7953 

0.8554 

0.8124 

0.6249 

QLT08 

REL09 

QTYIO 

RELll 

MAN12 

QTY13 

QTY13R 

REL09 

0.3684 

QTYIO 

-0.1720 

-0.5135 

RELll 

0.3902 

0.8483 

-0.4324 

MAN12 

0.2998 

0.7939 

-0.4732 

0.7669 

QTY13 

-0.1963 

-0.0770 

-0.1016 

0.0027 

-0.0914 

QTY13R 

0.1963 

0.0770 

0.1016 

-0.0027 

0.0914 

-1.0000 

QLT14 

0.7421 

0.3546 

-0.1551 

0.3835 

0.2916 

-0.2267 

0.2267 

QLT15 

0.5402 

0.4340 

-0.1619 

0.4378 

0.3667 

-0.2824 

0.2824 

MAN16 

0.3371 

0.8629 

-0.5351 

0.7886 

0.8606 

-0.0926 

0.0926 

QLT14 

QLT15 

QLT15 

0.6445 

MAN16 

0.3404 

0.3751 

MAXIMUM  DIFFERENCE  ALLOWED  BETWEEN  TIES  0.00001 


CASES  INCLUDED  120  MISSING  CASES  0 
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Spearman  Rank  Coefficient  of  Correlation  -  Summated  Data  by  Version 


Complete  Data  Set  —  Subjective  and  Demographic  Questions  —  SUMMATED 
DATA 

SPEARMAN  RANK  CORRELATIONS,  CORRECTED  FOR  TIES  —  All  Versions 
COHERENC  USABLTY  MANNER  RELATION 
USABLTY  0.8012 
MANNER  0.8391  0.8189 

RELATION  0.8151  0.7663  0.8766 

QUALITY  0.3725  0.3957  0.3991  0.4844 

MAXIMUM  DIFFERENCE  ALLOWED  BETWEEN  TIES  0.00001 
CASES  INCLUDED  120  MISSING  CASES  0 

SPEARMAN  RANK  CORRELATIONS,  CORRECTED  FOR  TIES  —  Version  A 
COHERENC  USABLTY  MANNER  RELATION 

USABLTY  0.9132 
MANNER  0.9522  0.9517 

RELATION  0.9422  0.8900  0.9719 

QUALITY  0.6688  0.6807  0.7317  0.6866 

MAXIMUM  DIFFERENCE  ALLOWED  BETWEEN  TIES  0.00001 
CASES  INCLUDED  15  MISSING  CASES  0 

SPEARMAN  RANK  CORRELATIONS,  CORRECTED  FOR  TIES  —  Version  B 
COHERENC  USABLTY  MANNER  RELATION 

USABLTY  0.8366 

MANNER  0.8996  0.8977 

RELATION  0.8313  0.8050  0.9096 

QUALITY  0.7014  0.7386  0.8456  0.8097 

MAXIMUM  DIFFERENCE  ALLOWED  BETWEEN  TIES  0.00001 
CASES  INCLUDED  15  MISSING  CASES  0 

SPEARMAN  RANK  CORRELATIONS,  CORRECTED  FOR  TIES  —  Version  C 
COHERENC  USABLTY  MANNER  RELATION 

USABLTY  0.5916 

MANNER  0.7037  0.6216 

RELATION  0.8452  0.6678  0.8591 

QUALITY  0.0995  0.0359  -0.0887  -0.0370 

MAXIMUM  DIFFERENCE  ALLOWED  BETWEEN  TIES  0.00001 
CASES  INCLUDED  14  MISSING  CASES  0 

SPEARMAN  RANK  CORRELATIONS,  CORRECTED  FOR  TIES  —  Version  D 
COHERENC  USABLTY  MANNER  RELATION 

USABLTY  0.7768 

MANNER  0.7369  0.7918 

RELATION  0.6259  0.7721  0.9013 

QUALITY  0.1542  0.0678  0.3004  0.4447 

MAXIMUM  DIFFERENCE  ALLOWED  BETWEEN  TIES  0.00001 
CASES  INCLUDED  14  MISSING  CASES  0 
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SPEAJRMAN  RANK  CORRELATIONS,  CORRECTED  FOR  TIES  —  Version  E 
COHERENC  USABLTY  MANNER  RELATION 

USABLTY  0.8743 
MANNER  0.8321  0.7974 

RELATION  0.7980  0.7188  0.8750 

QUALITY  0.1276  -0.0446  -0.0334  0.3401 

MAXIMUM  DIFFERENCE  ALLOWED  BETWEEN  TIES  0.00001 
CASES  INCLUDED  15  MISSING  CASES  0 

SPEARMAN  RANK  CORRELATIONS,  CORRECTED  FOR  TIES  —  Version  F 
COHERENC  USABLTY  MANNER  RELATION 

USABLTY  0.8597 

MANNER  0.6998  0.6609 

RELATION  0.8366  0.7816  0.8272 

QUALITY  0.4103  0.5836  0.2924  0.4496 

MAXIMUM  DIFFERENCE  ALLOWED  BETWEEN  TIES  0.00001 
CASES  INCLUDED  15  MISSING  CASES  0 

SPEARMAN  RANK  CORRELATIONS,  CORRECTED  FOR  TIES  —  Version  G 
COHERENC  USABLTY  MANNER  RELATION 

USABLTY  0.9441 

MANNER  0.9493  0.9051 

RELATION  0.8027  0.7443  0.7759 

QUALITY  0.4856  0.3194  0.4412  0.5981 

MAXIMUM  DIFFERENCE  ALLOWED  BETWEEN  TIES  0.00001 
CASES  INCLUDED  16  MISSING  CASES  0 

SPEARMAN  RANK  CORRELATIONS,  CORRECTED  FOR  TIES  —  Version  H 
COHERENC  USABLTY  MANNER  RELATION 

USABLTY  0.4110 

MANNER  0.7073  0.5433 

RELATION  0.8550  0.5489  0.9285 

QUALITY  0.3622  0.6142  0.5145  0.5160 

MAXIMUM  DIFFERENCE  ALLOWED  BETWEEN  TIES  0.00001 
CASES  INCLUDED  16  MISSING  CASES  0 
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Table  14 

Summary  of  Speannaii  Rank  Correlations  for  Summated  Constructs 


Construct 


EIS 

Version 


Coherence 


Manner 


Construct 


Quali 


Coherence 


Quality 


Usability 


0.8391 

0.9522 


0.7369 

0.8321 

0.6998 

0.9493 

0.7073 


0.3752 

0.6688 


0.1542 

0.1276 

0.4103 

0.4856 

0.3622 


0.7768 

0.8743 

0.8597 

0.9441 

0.4110 


0.8391 

0.9522 


0.7369 

0.8321 

0.6998 

0.9493 

0.7073 


0.3991 

0.7317 

0.8456 

-0.0887 

0.3004 

-0.0334 

0.2924 

0.4412 

0.5145 


Relation  I  Usabili 


0.6216 

0.7918 

0.7974 

0.6609 

0.9051 

0.5433 


0.3752 

0.6688 


0.1542 

0.1276 

0.4103 

0.4856 

0.3622 

0.3991 

0.7317 

0.8456 

-0.0887 

0.3004 

-0.0334 

0.2924 

0.4412 

0.5145 


.4844 

.6866 

.8097 

.0370 

.4447 

.3401 

.4496 

.5981 

.5160 


.3957 
.6807 
.7386 
0.0359 
0.0678 
-0.0446 
0.5836 
0.3194 
0.6142 


0.9096 

0.8591 

0.9013 

0.8750 

0.8272 

0.7759 

0.9285 


-0.0370 

0.4447 

0.3401 

0.4496 

0.5981 

0.5160 


0.6678 

0.7721 

0.7188 

0.7816 

0.7443 

0.5489 


0.0359 

0.0678 

-0.0446 

0.5836 

0.3194 

0.6142 
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Spearman  Rank  Coefficient  of  Correlation  Plots  bv  Construct 


Figure  57.  Spearman  Rank  Correlation  for  COHERENCE  Constnict 


Figure  58.  Spearman  Rank  Correlation  for  MANNER  Construct 
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Spearman  Rank  Correlation  Spearman  Rank  Correlation 


Figure  59.  Spearman  Rank  Correlation  for  QUALITY  Construct 


Speannan  Rank  Correlation 
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Figure  61.  Speannan  Rank  Correlation  for  USABILITY  Construct 


Appendix  E:  Power  of  the  F-Test  Calculations 

General  Description:  This  appendix  illustrates  the  calculations  that  were  performed  in  Microsoft  Excel  to 
compute  the  power  of  the  F-Test  used  in  the  ANOVA.  The  procedure  is  shown  below: 

By  the  power  of  the  F  test,  we  refer  to  the  probability  that  the  decision  rule  will  lead  to  conclu¬ 
sion  Ha  when  in  fact  Ha  holds.  Specifically,  the  power  is  given  by  the  following  expression: 

Power  =  P{F*  >  F(i  -  a,  r  - 1,  rtr- r)|^} 

where  <f>  is  the  noncentrality  parameter,  that  is,  a  measure  of  how  unequal  the  /m  are: 

^  =— and  H  =  (Neter  and  others,  1990: 634) 

a\  r  rij 

In  the  above  equations: 

nt  refers  to  the  number  of  cases  in  the  /*  factor  level, 
nr  refers  to  the  total  number  of  cases  in  the  study. 

Pi  refers  to  the  mean  value  of  the  ith  factor  level, 
p  refers  to  the  grand  mean  for  the  entire  study,  and 
©■refers  to  the  total  variance  for  the  study. 

Table  A-2  in  Keppel  (1991:  515)  was  used  to  obtain  the  values  for  power  at  vi  =  7  (degrees  of  freedom  in 
the  numerator  of  F*),  =  « (degrees  of  freedom  in  the  denominator  of  F*),  and  a  =  0.05  (level  of  sig¬ 

nificance).  The  results  are  shown  in  Table  13  on  page  55  of  Appendix  E. 

Calculations  performed  in  Microsoft  Excel  to  obtain  the  (j>  values  in  Table  13  are  shown  in  the  rest  of  this 
appendix. 
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120  Total  sanqjle  size  (/It-) 

8  Number  of  fector  levels  (r) 

7  F*  numerator  degrees  of  freedom  ( v;) 
112  F*  denominator  degrees  of  freedom  (^2) 
0.05  Level  of  significance  (a) 


A  2.2039  15  1.0000  15.0000  0.3011 

B  1.8127  15  1.0000  15.0000  0.3011 

C  1.7305  14  0.9286  13.0004  0.0691 

D  2.1432  14  0.8571  11.9994  0.0000 

E  1.7674  15  0.5333  7.9995  1.5846 

F  1.9198  15  0.6000  9.0000  1.0010 

G  2.0156  16  1.0625  17.0000  0.6670 

H  1.7842  16  0.8750  14.0000  0.0044 


A  2.5486  15  0.7333  10.9995  0.7592 

B  2.2509  15  0.7333  10.9995  0.7592 

C  2.0273  14  0.4286  6.0004  0.0890 

D  2.1031  14  0.5000  7.0000  0.0010 

E  2.1536  15  0.2667  4.0005  0.8758 

F  2.1269  15  0.3333  4.9995  0.4595 

G  2.4144  16  0.6875  11.0000  0.5136 

H  1.9621  16  0.3750  6.0000  0.2844 


fL  =  0.8583 

0.3633 


=  0.5083 

0.3097 
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MAN 

Factor 

Sample 

Level 

rii 

Mean 

nUti-fi.f 

A 

3.5657 

15 

1.0000 

15.0000 

0.4166 

B 

3.3905 

15 

1.0667 

16.0005 

0.8169 

C 

3.0500 

14 

0.9286 

13.0004 

0.1270 

D 

3.1062 

14 

0.5714 

7.9996 

0.9606 

E 

2.8149 

15 

0.2667 

4.0005 

4.8162 

F 

2.6851 

15 

0.7333 

10.9995 

0.1501 

G 

2.8048 

16 

1.5000 

24.0000 

7.1110 

H 

3.0104 

16 

0.5625 

9.0000 

1.1736 

3.0635 

120 

100.0005 

15.5721 

0.8333 

REL 

Factor 

Sample 

Level 

rii 

Mean 

rii^i 

n,{fii-fi)^ 

A 

3.4157 

15 

0.6667 

10.0005 

0.7044 

B 

3.5790 

15 

0.3333 

4.9995 

0.2043 

C 

3.0742 

14 

0.2857 

3.9998 

0.3779 

D 

2.7346 

14 

0.6429 

9.0006 

0.5210 

E 

3.5010 

15 

(0.4000) 

(6.0000) 

10.8375 

F 

2.6095 

15 

0.3333 

4.9995 

0.2043 

G 

2.7689 

16 

1.2500 

20.0000 

10.2400 

H 

2.7318 

16 

0.4375 

7.0000 

0.0025 

3.0715 

1  120 

53.9999 

23.0918 

0.4500 

1 

QLT 

Factor 

Sample 

Level 

rii 

Mean 

riijUi 

A 

1.9952 

15 

1.1333 

16.9995 

4.0037 

B 

2.1668 

15 

0.4667 

7.0005 

0.3373 

C 

1.4373 

14 

0.2857 

3.9998 

1.5335 

D 

1.4544 

14 

0.5000 

7.0000 

0.1906 

E 

1.7238 

15 

0.6000 

9.0000 

0.0042 

F 

1.7403 

15 

0.8000 

12.0000 

0.5042 

G 

1.9906 

16 

0.6875 

11.0000 

0.0803 

H 

1.7500 

1  16 

0.4375 

7.0000 

0.5136 

1.8057 

120 

73.9998 

7.1673 

0.6167 


ft  =  0.8333 

<t>=  0.4554 


ft  =  0.4500 

4>=  0.5531 


ft.  =  0.6167 

0.5242 
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P65 

Factor 

Sample 

Level 

CTi 

rii 

Mean 

rtiiA 

A 

1.2799 

15 

(0.0667) 

(1.0005) 

0.0167 

fi.  =  (0.0333) 

B 

1.1751 

15 

(0.3333) 

(4.9995) 

1.3498 

1.1122 

C 

0.9376 

14 

(0.5714) 

(7.9996) 

4.0534 

D 

1.0690 

14 

(0.2857) 

(3.9998) 

0.8917 

E 

1.0000 

15 

- 

0.0167 

F 

1.0328 

15 

0.2667 

4.0005 

1.3502 

G 

1.0935 

16 

0.4375 

7.0000 

3.5468 

H 

1.1673 

16 

0.1875 

3.0000 

0.7802 

1 

1.1014 

120 

(3.9989) 

12.0055 

1 

(0.0333) 

P66 

Factor 

Sample 

Level 

<yi 

Mean 

riifii 

tiiQii-H-f 

. 

L 

A 

1.0823 

15 

(0.2000) 

(3.0000) 

2.0165 

JU.  =  0.1667 

B 

1.1952 

15 

- 

- 

0.4166 

0.9659 

C 

1.2044 

14 

0.2857 

3.9998 

0.1984 

D 

1.0894 

14 

0.5714 

7.9996 

2.2935 

E 

1.1255 

15 

0.5333 

7.9995 

2.0164 

F 

1.1127 

15 

0.3333 

4.9995 

0.4166 

G 

1.1236 

16 

0.0625 

1.0000 

0.1736 

H 

1.1087 

16 

(0.1875) 

(3.0000) 

2.0068 

1.1305 

1  120 

19.9984 

9.5384 

0.1667 

P67 

Factor 

Sample 

Level 

rii 

Mean 

riifii 

nAprfif 

A 

1.2228 

15 

0.0667 

1.0005 

0.4165 

JU.  =  0.2333 

B 

1.2799 

15 

(0.0667) 

(1.0005) 

1.3502 

0.6435 

c 

1.2688 

14 

0.0714 

0.9996 

0.3671 

D 

1.2044 

14 

0.2857 

3.9998 

0.0384 

E 

1.0556 

15 

0.4000 

6.0000 

0.4167 

F 

0.9155 

15 

0.5333 

7.9995 

1.3498 

G 

1.0247 

16 

0.3750 

6.0000 

0.3212 

H 

1.1087 

16 

0.1875 

3.0000 

0.0336 

1.1385 

120 

27.9989 

4.2934 

0.2333 
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P68 

Factor 

■1 

Sample 

Level 

B 

Mean 

A 

1.1832 

15 

0,4000 

6.0000 

0.6000 

B 

1.1832 

15 

0.6000 

9.0000 

0.0000 

C 

1.1387 

14 

0.7143 

10.0002 

0.1829 

D 

0.9493 

14 

0.8571 

11.9994 

0.9254 

E 

1.1042 

15 

0.8000 

12.0000 

0.6000 

F 

1.0556 

15 

0.6000 

9.0000 

0.0000 

G 

1.0954 

16 

0.5000 

8.0000 

0.1600 

H 

1.2042 

16 

0.3750 

6.0000 

0.8100 

1.1081 

120 

71.9996 

3.2m 

0.6000 

P69 

Factor 

Sample 

! 

i 

Level 

B 

Mean 

niMi  1 

A 

1.0465 

15 

0.6667 

10.0005 

0.0167 

B 

1.0601 

15 

0.4667 

7.0005 

0.4166 

C 

1.0818 

14 

0.6429 

9.0006 

0.0013 

D 

1.0082 

14 

0.6429 

9.0006 

0.0013 

E 

0.9856 

15 

0.6000 

9.0000 

0.0167 

F 

0.9411 

15 

0.8000 

12.0000 

0.4166 

G 

0.9574 

16 

0.6250 

10.0000 

0.0011 

H 

1.0247 

16 

0.6250 

10.0000 

0.0011 

1.0133 

120 

76.0022 

0.8713 

0.6333 


li.  =  0.6000 

0.5777 


fi.  =  0.6334 

0.3257 
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